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Chapter I 



THE PROBIZM 



The Disadvantaged in Education 

I 

The hig cities of the United States have experienced marked changes 
of population in the past 20 years. This is true not only of Hew York 
City, but also of Philadelphia, Chicago, Detroit, Los Angeles and other 
major cities. A major factor has been the movement of hundreds of thous- 
ands of Negroes from the South into various parts of the North. The .devel- 
opment and expansion of crowded, run-down Negro ghettos has created unpre- 
cedented problems for public education. 

Many of the children growing up in these neighborhoods have not done 
well in school. They have been variously described as culturally deprived, 
educationally disadvantaged, or culturally different. It is not uncommon 
for the median reading ability in the seventh grade of schools in these 
neighborhoods to be two years or more below the national norms. Retardation 
in reading ability serves as a major barrier to success in most other areas 
of the curriculum. 

The Negro children living in the big- city ghettos probably form the 
largest group of seriously disadvantaged children in this country. 

Within the past five years, interest in inproving the education of 
the disadvantaged has greatly intensified. Currently the effort to upgrade 
the schooling of disadvantaged children forms one of the main efforts of 
the War on Poverty. 



Local Concern 



New York City has an increasing proportion of Negro children who 
enter the first grade inadequately prepared to begin formal schooling. Many 
thousands fail to make appreciable progress in reading during the first 
grade. 
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The staff of the Board of Education of the City of New Yorx are de- 
termined to improve the education of disadvantaged children. They have de- 
signates the elementary schools which have high proportions of disadvantaged 
pupils as Special Service Schools, and have allocated to these schools spe- 
cial facilities such as extra allotments of counselors, remedial teachers, 
and child guidance services. 

The Division of Teacher Education of the City University of New York 
is intensely interested in the problems of urban education and in the prep- 
aration of teachers for urban schools. The Office of Research and Evalua- 
tion, a unit of the Division of Teacher Education, was authorized in Janu- 
ary, 1964, to expand its program of research in urban education. 

In response to an announcement which the U. S. Office of Education 
issued in the Fall of 1963, inviting proposals for first-grade reading re- 
search studies, a preliminary draft of the proposal for the present study 
was prepared in the Office of Research and Evaluation and was submitted to 
the staff of the Board of Education of the City of New York for considera- 
tion. It was warmly welcomed. Several superintendents and directors agreed 

to serve on the advisory committees, and contributed greatly to the detailed 
plans. 



The Methods Chosen for Study 

The central comparison in this study of first-grade reading methods 
is between the Skills-Centered Approach and the Language-Experience Approach. 
The Skills-Centered Approach emphasizes \the need for order, structure, and 
built-in repetition. Skills are introduced in specific sequence, the voca- 
bulary is carefully controlled, and the teacher is provided with detailed 
lesson plans. The Language-Experience Approach emphasizes the need for self- 
expression through the use of the child’s oral language as a basis for be- 
ginning reading materials. His experiences provide a basis for concept- 
building, language enrichment and vocabulary development. Out of the dis- 
cussion of these experiences, chart stories are developed and used for read- 
ing and writing, for skills instruction, and for drill. The transition to 
book reading is gradual and individualized. 
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Each of these two main approaches was further divided into two 

<■ 

teaching methods, or variables. The Skills-Centered Approach was subdivided 
into Variable I, Basal Reader Method, and Variable II, Basal Reader Method 
with Phonovisual Word Recognition. The Language- Experience Approach was 
subdivided into Variable IH, Language-Experience with customary use of audio- 
visual aids, and Variable IV, Language-Experience with Audio-Visual Supple- 
mentation. In the research design, these four methods were treated as four 
separate experimental variables. A brief description of each of the four 
methods is given below. More thorough presentations of these teaching vari- 
ables will be found in Chapter IV. 

Variable I. Skills-Centered Approach: Basal Reader 

The great majority of American schools utilize basal readers in the 
primary grades. A basal reader is a highly structured, eclectic teaching 
program. The vocabulary is carefully selected, introduced gradually, and 
reviewed systematically. Each book is accompanied by a teachers* manual 
which gives detailed plans for each lesson, even suggesting specific word- 
ing for the teacher to use. An effort is made to give balanced attention 
to comprehension and word recognition shills. The skills program is further 
developed through the use of workbooks that are closely correlated with the 
readers . 

When this project was being planned a series of basal readers called 
the City Schools Reading Program was in process of publication. Written by 
staff of the Detroit Public Schools, they were to stress urban environments 
and multi-ethnic characters. The first preprimers had been published in 
1962 and a preliminary evaluation, published in November, 1963, was Quite 
favorable. The original plans of CRAFT were to use these basal readers. 

Fortunately, we learned on June 30, 1964, that many items in the 
City Schools series would not be available in time for our use; this »ave 
us enough time to choose an alternative. The reading consultants were 
called to an emergency meeting and reported that the basal readers already 
installed in their CRAFT schools were as follows: Scott, Foresman series, 

■** Whipple, Gertrude. Appraisal of the City Schools Reading Program . Detroit: 
Detroit Public Schools, Language Education Department, 19^3* 
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«U stools; Harper and R m series, four schools; Gian Basic Readers, two 
schools. In the opinion of the consultants and research staff these ser- 
ies were sufficiently alike in content and Methodology to justify consid- 
ering the use o{ the three series to be a single teaching Method. Each 
school was to use the series it had, being sure to provide the teacher 
with the full Materials (readers. Manuals, workbooks, and word and phrase 
cards). 

Variable H. Skill s-Centered Approach: Hionovisual Method with Basal Reader 

The Hionovisual Method is a highly structured way of teaching word 
attack skills, with a teacher's Manual, large consonant and vowel charts 
for use with groups, smaller charts for use by individual pupils, several 
workbooks, and a hook of games. It is designed to he used in conjunction 
with any basal reader series. In th& 12 CRAFT Hionovisual classrooms, the 
sections of the basal reader Manual dealing with the teaching of phonic 
and structural analysis of words were omitted, and in their place a separate 
Hionovisual word attack lesson was given each day. 

Variable III. Language-Experience Method 

The Language-Experience Approach is one in which emphasis is placed 
on the teaching of reading inclose correlation with the related language- 
arts activities of listening, speaking, and writing. Children are encouraged 
to express their thoughts, ideas, and feelings, often stimulated by a speci- 
fic experience guided and developed by the teacher. The verbal productions 
of the childr en are written dewn by the teacher in the early stages, and are 
used as the earliest reading materials. Pupil expression is encouraged 
through the use of a variety of media such as painting, speaking, and writ- 
ing. Gradually the program moves from exclusive use of reading material 
which is developed out of the oral language of the children, into a program 
of reading in which increasing emphasis is placed upon a variety of children's 
books. 
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Y>rttblf TV. Yangu a g e-Expcrlanco Method with Audio-Visual Supple mentation 

Since in the Language-Experience Method hath real and vicarious ex- 
periences can be utilised, audio-visual procedures seemed a precising nay 
to supplement the limited real-life experiences of these children. Audio- 
visual procedures could he used in a variety of nays: to record experi- 
ences for later recall and discussion, to present nen material with high 
vividness and attention-attracting impact, to provide correlation of lis- 
tening vith Hatching, etc. 

The Bureau of Audio-Visual Instruction of the Ken York City Schools 
provided several thousand dollars north of audio-visual equipment for the 
twelve Language-Experience-Audio-Visual teachers, and assigned a member 
of their staff to nork half-time vith the CBAFT Project, working out plans 
for the use of audio-visual techniques in cooperation with the reading 
consultants, training the Language-Experience-Audio- Visual teachers in 
the use of these techniques, making a photographic record of the lour 
teaching methods, etc. 

Aside from the use of a greater variety of audio-visual procedures 
and the effort to integrate then with the language arts teaching, the 
Language- Experience-Audio-Visual teacher followed the same practices as 
the other Language-Experience teachers. 

Experimental Controls 

The director of this project participated in the meetings held in 
March, 1964, and June, 1964, under the auspices of the U. S. Office of 
Education, and agreed to adhere to ths requirements set for the research 
studies that were to be part of the cooperative study of reading in the 
first grade. The same pretests would be used as in the other studies, with 
the exception of group intelligence tests which were not allowed to be 
given in the public schools of New York City. The same reading tests would 
be used as final tests, after the same period of 140 days. Uniform prac- 
tices in collecting, coding, and recording data common to all projects were 
agreed upon. Techniques to minimize or eliminate irrelevant factors that 
would tend to favor one or another method were carefully worked out. 
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Detail* of these precaution* can he found in the chapter on Procedure*. 

Specific Objective* 

The major questions to be studied were: 

i 

1. Does a significant difference in reading achievement exist between 
group* taught by Ski lls-Centered and Language-Experience approaches? 

2. Do pupil gains in reading under Skills-Centered teaching differ when 
the Basal Reader method is used as compared to the Phoncvi rj&l-Basal- 
Reader combination? 

5* Do gains by pupils given Language-Experience teaching depend on the 
amount of audio-visual enrichment? 

4. Do any of these methods of teaching tend to produce greater pupil 
gains in some skill areas than in others? 

5* Does the amount of success a teacher has with a method depend on hov 
faithfully she uses it? 

The following minor questions were also listed for investigation: 

6. What measure, or combination of measures, obtained at the beginning 
of the first grade is the best predictor of achievement in reading for 
this population? 

7* What characteristics of books determine pupils' reactions to them? 

8. What is the relationship of experience, training, and other teacher 
characteristics to success in teaching reading by each method? 



Chapter H 



RELATED RESEARCH 



The appearance each year of hundreds of books* periodical arti- 
cles* and other contributions dealing with the teaching of reading Bakes 
a detailed sunmary of even part of this vast field a project far beyond 
the scope of a research report like this, fairly comprehensive histories 
of reading instruction in the United States have recently been prepared by 
fries (7) and Sssith (15) • A good deal of the research on the teaching of 
beginning reading has been sumarized and analyzed by Chall (5). The 
Methods currently in favor in most American first-grade classrooms have 
been described by the director of this project in tiro recent books (9*10). 

A period of controversy concerning desirable practices in beginning 
reading instruction was started in 1955 with the widely popular Why Johnny 
Can't Read by Rudolph Flesch (6). 

A special coomittee on Research in Reading was appointed by the 
Rational Conference on Research in English. This coamittee had the oppor- 
tunity to engage in two extended face-to-face meetings* one in 1959* and 
one in i960. The coamittee agreed that the area of beginning reading in- 
struction was a major area needing further research. There was quite gen- 
eral agreement among the coamittee members that the research evidence then 
available was sufficiently vague* contradictoxy* incomplete, and faulty in 
design and execution to allow a wide range of conflicting interpretations 
to be drawn. The comittee developed a schema of the controls that satis- 
factory research in this area should require* and proposed that large-scale 
cooperative experiments should be planned and carried through to compare 
different approaches to beginning reading systematically and tith overlap- 
ping and replication of variables. 

The present study is one of a group of cooperative studies supported 
in part by the Cooperative Research Branch of the U.S. Office of Education. 
Invitations to submit proposals were made public by the Office of Education 
in the fall of 1963. By March 1* 1964* a large number of proposals had been 
submitted. In June the 27 projects selected for support were announced. 
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Each project was to receive an amount up to but not exceeding $30,000, 
and was expected to find local financial resources to take care of ad- 
ditional expenses. 

Beginning Reading for the Disadvantaged 

There is essentially no good controlled research on the relevance 
of the general methods of teaching beginning reading to meeting the speci- 
fic educational needs of culturally disadvantaged children ° 

According to Riessman, the disadvantaged person tends to have a 
strong preference for traditional education in contrast to progressive 
education, which he firmly rejects. "Certainly, it must be said, there 
are a fair number of progressive-minded teachers who, in stressing vivid, 
example-centered lessons, have been successful with deprived children. 

But on the average, it is the old-style, strict, highly structured teacher 
who appears to be most popular and effective with underprivileged chil- 
dren. . . The traditionalist contributes structure, rules, discipline, 
authority, rote, order, and strong external demands for achievement." 

(1U, p.72) 

It was decided that the contrast suggested by Riessman, between 
an approach emphasizing structure, rules, rot* and order, and one stress- 
ing a "progressive" approach with emphasis on ego-building and enrichment 
of experience and language, would provide the major comparison in the 
study. 

The Harvard-Camegie and Columbia-C&rnegie surreys have recently 
revealed that the vast majority of first-grade teachers in this country 
teach reading with a series of basal readers; the percentage doing so 
runs well over 90 (3,4) . Accordingly, no defense needs to be made of the 
inclusion of the use of basal readers in a research study on beginning 
reading. As was pointed out in Chapter I, our original intention was to 
utilize a new series of basal readers written specifically for use with 
non-white disadvantaged children. However, delays in the publication of 
that series made it neeessaxy to switch to standard basal readers at al- 
most the last msaent. 

The superintendent of schools of Washington, D. C., a city with a 
very high proportion of Negro children in its public schools, has ccs» 
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out very strongly for a skiUs-centered approach. As described by Han- 
sen in The Aaidon Elementary School (8), the beginning reading method 
is a combination of basal readers vith systematic teaching utilizing 
the ¥honovisuftl method, a published phonic system. The Phonovisual 
teaching takes place in a separate period each day, and the teacher is 
instructed to disregard the word-attack lessons in the manuals for the 
basal readers. At the time the variables for the present study were 
being selected, information was received that this combination had been 
adopted city-wide in Washington, D. C., and therefore it seemed reason- 
able to select this as a second skills- centered method of instruction. 

While many other methods stressing skills teaching were available, this 
particular one was the only one for which v<s were able to find evidence 
of large-scale tryout with disadvantaged children. 

The Language-Experience Approach has been used in various forms 
since at least as early as the 1890 ' s (ll). It has been described in 
detail in a recent book by Lee and Allen (12) • A variation of this 
method is described by Ashton-Warner in the books Spinster and Teacher 
(1*2). Miss Ashton-Warner' s experience had been in the teaching of young 
Maori children in New Zealand. Her descriptions of the Maori children 
and their behavior in school showed many resemblances to the behavior of 
disadvantaged non-white children in urban schools in the United States. 

The teachers assigned to the Language-Experience Approach were encouraged 
to read the books by Lee and Allen and Ashton-Warner, and were given mimeo- 
graphed excerpts of seme of the most significant passages in those books. 

A project in the utilization of audio-visual aids in primary grade 
classes had been conducted under ihe auspices of the Bureau of Audio-Visual 
Instruction of the New fork City schools. Informal evaluation of the re- 
sults obtained had been quite favorable, and the director of BAVX expressed 
a strong interest in further exploration of the possibilities in the utili- 
zation of audio-visual procedures in beginning reading instruction. Ac- 
cordingly, it was decided that one-half of the teachers in the Language- 
Experience Approach would be given "special supplementary audio-visual 
equipment and supplies, and would be taught how to utilize this equipment 
by a consultant assigned by the Bureau of Audio-Visual Instruction. 

In addition to successful local informal tryout, the use of film- 
strips as a way of enriching experience and making reading easier has been 
supported by the research of Witty (l? ) • The use of film-strips particularly 
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to reinforce the first-grade progni has also been strongly advocated 
by McCracken (13)* 
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Chapter IH 



PROCEDURES 



The Schools 



Selection of Schools 

The purpose of the CRAFT study, namely the determination of the 
relative effectiveness of various methods in teaching first-grade Hegro 
disadvantaged urban c hildr en to read, necessitated setting down speci- 
fic criteria for selection of schools. Eaese criteria, established at 
meetings of the Project Advisory Board on March 12, and later revised, 
were formalized in the following list: 

1. A Special Service school.^ 

2. Minimally 85 ^ non-white population in first grade. 

5* A of five classes and a ,*>* nine classes in 

the first grade. 

4. Assurance of full cooperation from the district superintend- 
ent and the school principals. 

5. W i ll in g ne ss of at least four first-grade teachers to take 

part in the study. 

Schools fitting these criteria appeared to be concentrated in 
five school districts: two in the central Harlem section of Manhattan, 
two in the Bedford-Stuyvesant section of Brooklyn, and one in the South 
Jamaica section of Queens. 

Bie final selection included 11 schools which fitted the cri- 
teria completely and only one. School 1 (see Table l), which was not 

1 Designation of Special Service Schools, based on established 
practice, involved evaluation by a ccamittee of assistant superintend- 
ents according to five criteria (weighted to make a total of 100) : 

1. Average reading grade. 

2. Per cent of pupils on free lunch. 

3. Pupil mobility. 

4. Per cent of pupils with language handicaps. 

5. far cent of teachers on permanent license. 

previously a criterion, did not enter the consideration during 
the year 1964-65. 
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listed as a Special Service school. The presence in thi* school of a 
considerable mafcer of foster children justified considering nan? of 
its pupils “disadvantaged •* nevertheless School I was the least dis- 
advantaged of the schools. 

In order to protect the anonymity of the schools, a letter code 
irill be substituted througicut this report for school designations. 

In the schools thus selected, cultural and economic deprivation 
bad resulted in depressed reading scores, with a lag of one-half year 
to over a year in each school by the end of the third grade. Table 1 
provides the mean reading achie f eaent scores in Word Knowledge and 
Comprehension near the end of the third grade on the most recent city- 
vide survey available when the selection was being wade. 

TABLE 1 

THIRD GRADE METROPOLITAN READING TEST MEDIAN SCORES 



School 


Word Knowledge 


Comprehension 


A 


3.1 


3.3 


B 


2.7 


2.8 


C 


2.5 


2.6 


D 


2.8 


3.0 


E 


2.7 


2.7 


F 


2.9 


2.9 


G 


2.8 


2.9 


H 


2.6 


2.7 


I 


3.5 


3.4 


J 


3.1 


3.2 


K 


2.8 


3.0 


L 


3.3 


3.3 



Although considerable differences were apparent aaong the schools 
in the project, all were faced with the problem of reading retardation 
associated with deprivation in ghetto areas. 

The population selected to participate in the CRAFT project was 
limited to low socio-economic Negro ghetto areas in Harlem, Bedford- 
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Stuyraiant, and South Jamaica. Table 2 indicates the median income and 
median education of each school neighborhood, as extracted from the i960 
Census Tract data. It is evident that there is a considerable range in 
both income and education, with School I again the highest. 



TABLE 2 

MEDIAN INCOME AND EDUCATION FOR CENSUS TRACTS 
IN WHICH IKE SCHOOLS ARE LOCATED 



School 




Median Annual Income 


Median Education Attained 


A 




$5,576 


10.2 


B 




5,147 


9.0 


C 




5,555 


8.9 


D 




5,751 


8.7 


K 




1,980 


8.8 


F 




5,918 


9.1 


G 




4,528 


8.6 

* 


H 




4,040 


9.0 


I 




7,055 


11.5 


J 




5,744 


9.0 


K 




4,976 


9.1 


L 




4,975 


9.* 



Assignment of Methods to Schools and Classes 

Each of the twelve schools was to lave four classes in the project, 
two in one of the Language-Experience methods and two in one of the Ski 11s- 
Centered methods, a total of U8 classes. The possible combinations of 
methods were: Language-Experience with Phonovisual; Language-Experience 
with Basal Reader; Audio-Visual with Bhonovisu&l; and Audio-Visual with 
Basal Reader. Each method would be present in 12 classes, two in each 
of s3x schools. 
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The need for random assignment was explained to the principals 
and accepted by them. At a meeting in Hay, 1964, each of the reading 
consultants drew lots for the pair of variables for each school in her 
district. At a subsequent meeting of the first-grade teachers in June, 
1964, the four teachers in each school drew lots for assignment to one 
or the otuer of the two variables in that school. Thus the variables 
were assigned to schools, and to teachers within each school, by a ran- 
domized procedure. These assignments are shown in Tfcble 3. 

Pupil Assignment to Variables 

Information obtained from the Advisory Committee and from the 
school principals indicated that all of the schools had previously em- 
ployed some form of ability grouping in the first grade. The kinder- 
garten children were rated by their teachers and these ratings were used 
to place them in a number of "homogeneous" classes. Children entering 
in September without kindergarten experience were usually placed in other 
classes, which were expected to make slower progress. 

At planning meetings with the principals, the research need for 
randomizing the assignment of pupils to variables was stressed, and the 
principals agreed to forego ability grouping in the project classes, 
lheir request to set up separate classes for kindergartners and non- 
kindergartners was adopted in the schools where each of the two variables 
could have two classes of kindergartners and two classes of children 
without kindergarten experience . Since the latter children usually did 
not register for school until September, special planning was necessary 
to insure random assignment of the non-kindergarten children to classes. 

The pxan was to assign pupils to classes frcm the entire kinder- 
garten population within each school by means of & table of random num- 
bers. Any two of these randomized classes could then be included in 
the CPAFT project as the two with kindergarten experience . The childr en 
without kindergarten experience would be assigned to other classes, also 
by & table of random nuutoers, as they registered for the first grade, 
aid asy two of these non-kindergarten classes could be used to complete 
the contingent of four CRAFT classes. One kindergarten class and one 
non-kindergarten class were to be assigned to each of the two variables 
operating in the school. A sufficient number of children with and without 
kindergarten experience mi available in eight schools to accommodate 
the kindergarten-no kindergarten dichotomy; in four schools, this 
dichotomy mu not feasible. 
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Because it was well into June before the GRAFT research staff 
could begin its work, preliminary class assignments had already been 
made in most of the schools. The CRAFT plan necessitated reorganization 
of the classes coming from the kindergartens. At meetings held with the 
principals and district superintendents, some objections were raised. 
Plans adapted to the special situations in specific schools, but main- 
taining the principle of random assignment between the two variables 
in the school, were worked out in consultation with Dr. Donald Medley. 

1. In Schools A and B, every seventh name on the kindergarten 
list was assigned to CRAFT classes. 

2. Schools C, D, 2, F and H sent their total kindergarten re- 
gisters to our office and we assigned them according to* a 
table of random numbers. 

5. School G siphoned off two "top” classes and then, by a head- 
tails procedure, assigned the remaining children to the two 
assigned variables. This school was the only one where ran- 
domization from the whole population was not effectively 
controlled by the research staff. 

4. School C placed 20 of their slowest pupils (as subjectively 
rated by kindergarten teachers) into* a separate class before 
sending the rest of the names to the research office for ran- 
domization. 

5« The principals of Schools I, J, K and L felt that because of 
the high degree of mobility in their districts, it would be 
preferable to assign the classes randomly in September. None 
of these schools expected to have enough children without 
kindergarten experience to provide two fill non-K classes. 

Thus, these four schools did not have the kindergarten, non- 
kindergarten dichotomy; children with and without kindergarten 
experience were randomized into the classes from the total 
population of the first grade in September. 

6. The principal of School I, the only non-Spec ial Services school 
in the project, was permitted to siphon off two classes from the 
top of his kindergarten distribution. It was expected that the 
remaining children would more closely resemble the population 
in the other schools in the project. 
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Huatoer of Roils 

The original number of children in the 48 classrooms at the 
start of school, September, 1964, was approximately 1,700. I fcr October 19th, 
when the pretests were completed, the number was reduced to 1,373, both 
by transfer to other schools and by dispersal to new classrooms. By post- 
test tiam, the first week in June, 1965, a 17 .2 $ loss (237 pupils) brought 
the experimental population deem to l,l4l who took both pretests and post- 
tests. 

Class Size 

The planners of this project felt that the results should be gen- 
eralizable to comparable schools in Hew York City and other urban centers, 
and that it was better to have the participating classes representative 
of the current situation in the participating schools than to set them 
up in as ideal a fashion as possible. With regard to class size, the 
classes were to be of the same size as the other first-grade classes in 
their schools. As experimental children left the school, their places 
were filled in the same manner as vacancies in the ron-experimental 
classes. 

The size of classes in some of the schools— over 30 children in 
most schools, and over 35 for part of the year in some schools— was a 
surprise and a disappointment to the research staff. It had been ex- 
pected that most classes would have fewer than 30 children. Neverthe- 
less the principle of not making the project classes smaller than the 
other first-grade classes in the same school was maintained. 

Although there was name variation in class size among schools, 
the classes assigned to the two variables within a school were kept 
approximately equal* While the number of experimental children 
varied from class to class by the close of the posttest program, the 
classes were kept up to size by adding newcomers to fill vacancies. 

For this reason the number of experimental pupils per class is not a 
true measure of class size. The difference between experimental and 
instructional class size is a measure of mobility of the pupil popula- 
tions. 

Table 4 shows the number of children who completed the pretests, 
the mmber who took both pretests and final tests, and the number who 
left the school between the two testings. . The number lost fluctuated 
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t&m school to school, hut on the whole was considerably mller t ha n 
¥e had anticipated, irlth a i?.2* loss overall* 3he Manhattan popular 
tlon had the largest loss (25*) and Queens the least (12.8*), with 
Brooklyn In between. 



TABLE 4 

hjpil loss sr scboois abb b 






School 




Itosfcar of Children 




Pretest 


Posttest 


L088 


A 


122 


89 


55 


B 


no 


84 


26 


C 


no 


90 


20 


D 


101 


80 


21 


E 


99 


80 


19 


P 


126 


102 


24 


6 


102 


88 


14 


H 


115 


102 


15 


I 


157 


n4 


25 


J 


Ilk 


98 


16 


K 


119 


105 


14 


L 


125 


109 


14 


Total 


1,373 


1,141 


257 


Per cent of Loss: 


Queens 


12.8* 






Brooklyn 


17.0* 






Manhattan 


25-4* 






Total 


17 . 2 * 





Classes with Four-Hour Lavs 

One of the irrelevant factors that could influence the results, 
and that was not subject to exnerhnent&l control, was the fact that in 
some schools of New York City overcrowding requires that certain grades 
have split sessions (two sessions of four hours each). Instead of the 
full five-hour day consisting of a three-hour morning session, lunch 
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period, and a two-boor afternoon session. Because population shifts 
in the disadvantaged neighborhoods in which the project schools were 
located are sometime* unpredictable, several of the principals were 
unable to inform the research staff in the Spring of 1964 whether 
their first grades in 1964-65 would be on four-hour or five-hour days. 
Since there were not enough extra schools Which met the selection cri- 
teria and were located within the chosen districts to replace all of 
the doubtful schools, it was decided to keep those schools in the 
study. 

It turned out that three of the twelve schools had their first- 
grade classes on four-hour days. The CRAFT classes in these schools 
all were in the morning shift. In each school, two classes were in 
one of the Language-Experience variables and the other two were in one 
of the Skills-Centered variables. Three of the four variables had 
seme four-hour classes; one did not. 

It will, therefore, be necessary in the analysis of results 
to check on whether achievement in the three four-hour schools was af- 
fected by the shortened school day, and if necessary to control f jr 
this factor statistically. 



The Pupils 



Pretest Scores of CRAFT Children 

Pretest measures were analyzed to ascertain the readiness of 
the CRAFT children in comparison with the general population. Percen- 
tile ranks of the means of the readiness subtest scores were computed. 
Table 5 shows the Keans, and the Percentile Rank of the Keans, 
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according to test norms. 



21 



table 5 

MEANS, MEAN PERCENTILE RANK, AND STANDARD DEVIATIONS 
CP READING READINESS SUBTEST SCORES OF THE 
CRAFT CHILDREN, OCTOBER, 19 64 



Test 


Means 


Percentile 
Rank of Means 


SD 


Murphy-Durrell Phonemes* 


9*200 


1 


8*580 


Murphy-Durrell Cap + Low" 


18*971 


25 


15.549 


Murphy-DurreH-Cap A 


10*599 


20 


8*858 


Murphy-Durrell-Low 


8.272 


23 


7*218 


Murphy~B«rrell Learning Rate 


7*592 


34 


4 *489 


Metropolitan ¥ord Meaning 


5*045 


12 2 


2*396 


Metropolitan Listening 


6,585 


so 2 


2*655 



Due to errors of administration, the scores oo these subtests 
were Invalidated for some entire classes* # 



^Estimated by using areas under the normal curve and the means 
and standard deviations given for the subtests* 



Analysis of this data indicates that the mean pretest scores of 
children in the CRAFT Project ranged between, the first and 34th per- 
centiles according to test norms. In auditory discrimination of 
phonemes, knowledge of letter names, and comprehension of word and 
phrase meanings orally presented, the CRAFT children all clustered 
in the lowast quartile, with particular depression in the Fhonss&es 
test. It seems highly significant that the mm score in the Phonemes 
subtest ranked at only the first percentile according to the test norms? * 
Tfrt< higher mean score (>4ta percentile) in Learning Rate indicates po- 
tential learning ability considerably above the attained development 
of the pupils in the perceptual, conceptual, and language modalities* 

Preschool Experience 

The SBjcunt of preschool experience of the CRAFT children is 
shewn in Table 6. 



TABUS 6 

PRE - FIRST CcKAOE SCHOOL EXPERIENCE 
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Variable 


No K or Pre-K 
Experience 


21-100 
Eaif Days 


Fun 

Kindergarten 


Kindergarten 

Plus 


No. 


$ 


No. 


$ 


No. 


$ 


No. 


$ 


I. B.R. 


101 


54.8 


17 


5.86 


162 


55.9 


9 


5.10 


II. PH. 


89 


51.4 


8 


2.82 


178 


62.9 


7 


2.47 


in. L.E. 


86 


29*9 


5 


1.74 


189 


65.6 


8 


2.78 


I V. L.E.-A.V. 


86 


50.9 


15 


5.40 


166 


59.7 


n 


5.96 


Totals 


562 


51.88 


45 


5.96 


695 


6l.O 


35 


5.08 



The large proportion of children who had no kindergarten or pre- 
kindergarten experience of any kind (51*88$) or a minimal amount of pre- 
first-grade experience (5*96$)* adds to the general picture of cultural 
deprivation of the CRAFT population, considering that free public kinder- 
gartens were available to all. About two— thirds of the children had hau 
full kindergarten* or kindergarten plus other preschool experience. The 
differences among the four variables were small and not significant. 

The Teachers 



Selection of Teachers 

The orientation of the research staff toward the selection of 
teachers was that: (l) it was desirable to have a representative sample 

of the total teacher population of the city as regards age, number of 
years of experience, education, effectiveness, etc.; (2) it was desirable 
to have participation in the project voluntary rather than mandatory or 
pressured; and (5) assignment of teachers to teaching methods would be on 
a random or chance basis. 

Within each of the schools selected, the principal was asked to 
enlist four volunteer first-grade teachers for the project. It was anti- 
cipated that people who voluntarily undertook to work in a research pro- 
ject would be flexible and willing to change their ways of teaching to 
suit the assigned variable. Eat. * teacher was to be paid $200 for the 
substantial amount of after- school time that participation would involve. 
This eased the recruitment problem considerably. Ease of recruitment 
into the project varied from school to school, and in several schools. 
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changes were made even after the first training session in June. One 
school changed its entire roster of project teachers as late as Septem- 
ber, 1964. 

Teacher Characteristics 

The 48 teachers who finally made up the roster varied in age, 
total number of years of experience, number of years of first-grade ex- 
perience, educational level, and prior approaches to reading toward the 
experimental methods proposed in the CRAFT project. The large varia- 
tion is shown in the following tables. 



TABLE T 

AGE, TOTAL TEACHING EXPERIENCE, AND FIRST-GRADE TEACHING 
EXPERIENCE GF THE CRAFT TEACHERS 





Range 


Median 


Mode 


Mean 


S.D. 


Age (years) 


21-66 


27.0 


24.0 


55.2 


12.7 


Total number years 
teaching exper. 


0-40 


4.5 


1.0 


7.92 


9.62 


Total number years 
first-grade teach- 
ing exper. 


0-29 


2.0 


1.0 


5.85 


5.22 



Despite the wide range of age and years of teaching experience 
as indicated in Table 7> CRAFT teachers tended on the whole to be young 
and inexperienced, as shown by the median age of 27 and the modal age of 
24, the median of 4.5 years of teaching experience and the modal number 
of 1.0 yea. teaching experience. Ten teachers had had only one year's 
experience, two were first-year teachers, while three had 50 or more 
years of experience. 

After random assignment of teachers to the four variables, the 
comparisons among the four groups of twelve teachers each are shown in 
Tables 8, 9> and 10. Table 8 shows the results for Age; Table 9 , for 
Total Years of Teaching; Table 10, for Years of First-Grade Teaching. 

In all of these there was wide variability within each group. The dif- 
ferences in means between the groups, hcwever, are not significantly 
different, according to one-way analyses of ‘variance (Table 8, F = 0.82; 
Table 9, " = 1.07; Table 10, F = 1.10). 



TABUS 8 



MEANS, MEDIANS, STANDARD DEVIATION, AND RANGES 
OF ACE 05“ TEACHERS BY VARIABLE 



Variable 


N 


Mean 


Median 


S.D. 


'tange 




I. B.R. 


12 


31 .U 2 


24.5 


13.24 


21-57 




n. PH. 


12 


55.08 


25.5 


15.42 


21-59 




in. L.E. 


12 


U 0.17 


40.5 


13.46 


23-58 




IV. A.V. 


12 


3^.25 


26.5 


15.89 


21-66 




Totals 


48 


35.23 


27.0 


12.74 


21-66 




TABUS 9 



MEANS, MEDIANS, STANDARD DEVIATIONS, AND RANGES 
FOR TOTAL YEARS OF TEACHING EXPERIENCE 
BY VARIABLE 



Variable 


N 


Mean 


Median 


S.D. 


Range 


I. B.R. 


12 


3.83 


2.5 


3.10 


1-9 


II. PH. 


12 


8.33 


5.0 


9.63 


0-30 


m. L.E. 


12 


9.25 


5.0 


9.25 


1-30 


IV. A.V. 


12 


10.25 


5.0 


13.10 


o-4o 


Totals 


48 


7.92 


4.5 


9.62 


o-4o 


TABLE 10 



MEANS, MEDIANS, STANDARD DEVIATIONS, AND RANGES 
FOR YEARS OF FIRST-GRADE TEACHING EXPERIENCE 

BY VARIABLE 



Variable 


N 


Mean 


Median 


S.D. 


Range 


I. B.R. 


12 


2.17 


2.0 


1.32 


1-4 


n. PH. 


12 


2.83 


1.5 


3.24 


0-10 


m. L.E. 


12 


3.83 


3.0 


3.73 


0-14 


IV A.V. 


12 


5.92 


2.5 


9.28 


0-29 


Totals 


48 


3.69 


2.0 


5.22 


0-29 
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Educational Level of Teachers 

The educational level of the 48 participants, presented in 
Table 11, showed considerable variation, ranging fro® three who lacked 
a bachelor's degree to four who had credit beyond a master's degree. 

The Majority had bachelors' degrees and sons graduate work. The spread 
in each variable is large. 



TABLE 11 

EDUCATIONAL U3VEL OF THE CRAFT TEACHERS IN EACH 
OF FOUR VARIABIE8 



Variable 


Less Than 

BA. 


BA. 


BoA.+ 


HA. 


M.A.+ 


Total 


I. 


B .R . 


0 


4 


7 


0 


1 


12 


II. 


PH. 


0 


2 


8 


1 


1 


12 


III. 


L.E. 


1 


1 


8 


0 


2 


12 


IV. 


A.V. 


2 


3 


5 


2 


0 


12 


All 4 Variables 


3 


10 


28 


3 


4 


48 



For the purpose of measuring teacher practice at the beginning 
of the project, the Teacher Inventory of Approaches to the Teaching of 
Reading, prepared by the Reading Study Project C ommi ttee of the San Diego 
County Department of Education, had been selected by the directors in- 
volved in the Cooperative Research Program. This questionnaire was ad- 
ministered to the CRAFT teachers as they entered the first session of the 
training workshop in September, 1964. 

Table 12 shows the scores of the CRAFT teachers on the three parts 
of the Inventory: (l) Basic Approach , represented by the basal reader 

method, used in Basal Reader and Fhonovisual variables; (2) Language- 
Experience Approach, represented by the beginning stages of reading in 
our Language-Experience variables; and (3) Individualized Approach, repre- 
sented by the later stages of reading in our Language-Experience variables. 

The results shewn in Table 12 indicate that as the CRAFT teachers 
entered the project, they tended as a group to score significantly higher 
on the Basic scale than on Language-Experience (p<.Ol) and Individualized 
scales (p<.G5). There was an insignificant difference between the Language 
Experience and Individualized means, both of which are aspects of the 
Language-Experience variables in the current project. 
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TABLE 12 

MEANS AND S TAHDA RD DEVIATIONS OF 48 TEACHERS OR THE THREF 
APPROACHES INCLUDED IN THE SAN DIEGO TEACHER INVENTORY 
OF APPROACHES TO TEACHING OPKEADmi ~ 






Approach 



Keans 



S. D. 



of differences 



a) Basic 


*0.31 


5*77 


(a^b) 


2.08 


Lf\ 

O 

• 

V 


b) Individual 


39*96 


5*37 


(b,c) 


* 79 


N JS. 


c) Language-Exp. 


38.48 


7*39 


(a,c) 


2.6o 


< .01 



The San Diego Inventory does net provide scales to differentiate 
between the two Language-Experience variables or between the two Skills- 
Centered variables of the CRAFT project. Table 13 shows the scores for 
the teachers assigned to Skill s-Centered variables as conpared to those 
of the teachers assigned to Iftnguage-Experience variables. In both 
groups the Basic score was highest. The differences between the two 

groups are snail in conparison to the variabilities and are not statisti- 
cally significant. 

TABLE 13 

MEANS AND STANDARD DEVIATIONS OF TEACHER INVENTOR Y 
OF APPROACHES TO THE TEACHING Qg"lfflADING SCRIES 
FOR TEACHERS ASS IGNED TO IANGUACEB-EXPER2ENCE 
AND SKILES-CENTERED TEACHING METHODS 



San Diego Scale 



SkiUs-Centered 
Mean S.D, 



Lang .-Experience 
Mean S.D. 



Basic 


44.75 


4.69 


41.88 


6.36 


1.74 


N.S. 


Individualized 


39*79 


6.o4 


40.12 


3.97 


0.22 


N.S. 


Lang.-Exper. 


36.92 


7.90 


40.04 


6.51 


1.47 


N.S. 




(N 


u 


(N 


' 

1! 







IerJc 






a 
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The Prog yam for the Year 

r 

Uniform Readings! Period 

The first 20 school days were plumed to be uniform for ell 
variables, mod to be devoted to the development of reediness. This 
ves necessary for severel reasons. Several of the schools did not 
have their first-grade classes organised until the end of September. 

Many of the children, especially the one-third who had not had any 
kindergarten experience, needed basic training in classroom behavior. 

At the all-day workshop session before school opened, the early 
childhood consultant discussed the importance of developing readiness 
in disadvantaged children and provided specific suggestions about acti- 
vities that would he appropriate in all classrooms during the unifora 
readiness period. Further help in developing reading readiness acti- 
vities was given in the weekly teacher workshop sessions. 

Oral language was encouraged; reading and writing were not to 
he started. Setting up routines was the focus of much oral communica- 
tion. Rules were established for use of the block shelf, the library 
corner, the science corner, the painting area. Discussion also engen- 
dered much interest in specific books, further browsing and picture 
reading of a large number of trade picture books. Favorite stories 
and nursery rhymes were dramatized, using puppets and flannelhoard. 

Talk centered around the neighborhood, and walking trips were arranged 
to different kinds of stores, public libraries, police stations and 
fire stations. Auditory discrimination was developed by a variety of 
listening activities oriented to science, music and language content* 

The use of colored materials, picture puzzles, etc. gave practice in 
visual discrimination, enriched concepts ana stimulated verbalization. 
During this non-reading but very verbal readiness period, development 
of skills was limited to realia; no rexographed sheets or readiness books 
were permitted. Telephones, records, radios, magnets, trucks and numer- 
ous other objects were used to enhance both conceptualization and ver- 
balization. 
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The Pretesting Program 

The pretesting program could not adhere completely to that de- 
cided upon for all cooperating projects, because the Board of Education 
had prohibited the use of group intelligence tests such as the Pintncr - 
Ctumia&am . In addition, the difficulty of some of the tests and the 
length of the total pretest program dismayed the consultants, who strong- 
ly urged a briefer battery. In order to provide adequately for compari- 
sons both between variables in this study and between this project and 
other first-grade studies in the Cooperative Research Program, a slight- 
ly reduced pretest program was carried out. It included the following: 

Murphy- Durrc 11 Diagnostic Reading Readiness Test (Experimental Form) 
Phonemes 

Letter Hemes - Capitals 
Letter Names - Lower Case 
Learning Rate 
Thurstone Battern Copying 
Thur stone Identical Forms 
Metropolitan Readiness Tests 
Word Meaning 
Listening 

Scheduling of the testing program was a complicated process . In 
twelve schools, in three widely separate parts of the city, tests had to 
be administered almost simultaneously to 48 classes, each of which was 
divided into two groups for testing. Each of these 96 groups was given 
eight tests, in four sessions. 

To equalize variations in examiner skill between the two major 
approaches and to have the tests administered by persons whom the chil- 
dren were beginning to knew, each of the faff classroom teachers in a 
school was trained to give the tests that comprised one session. She 
gave these tests to all four classes (8 groups) . Each teacher was as- 
signed a - >*oc tor-observer, who was either a member of the CRAFT research 
staff, one of the fiv* consultants or a special teacher without a 

home-roca assignment < . school's faculty. 

The pretest administration took from October 1 through October 8 , 
1964. During this period, when the children were not taking tests, the 
teachers continued with the readiness program. Make-up tests were 
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scheduled for October 15 to 27. Many children who had missed some of 
the subtests completed the testing during this period. 

The testing period was a trying one for pupils, teachers and 
school administrators* The pupils had never been tested before, found 
it hard to understand and follow directions, and found the tests quite 
difficult and frustrating. School administrators worked with the re- 
search staff on scheduling the four testing teams with the eight pupil- 
groups, and making provisions for the four half-classes not being tested 
during each session. Occasional teacher absences complicated the sched- 
uling problem. The teachers did not enjoy giving the same tests to eight 
groups of children. As a result, morale in the schools dropped sharply 
during the pretest program, and many complaints came to the research 
staff. 

When the tests were scored, it was discovered that a small number 
of e xamin ers had made errors in test administration which invalidated the 
pupil scores on some of the tests. For example, the Murphy-Durrell test 
of lower-case letters was completely overlooked in two schools. Another 
error, discovered only in the scoring, was failure to direct pupils to 
turn the page when a test was on more than one page. The research staff 
decided not to use scores on tests where the test blanks gave clear evi- 
dence of feulty administration, or the proctor-oh servers reported errors 
in administration serious enough to invalidate the results. 

The tests were scored by a crew of college student assistants 
supervised by a research assistant, during the early part of the instruc- 
tional period. 

The Instructional Period 

All teachers began their reading instruction on October 19> 19&4, 
and continued for 140 school days to May 27, 19^5 • Details about the 
methodology employed by the teachers within each of the four variables 
can he found in Chapter IV of this report. 

During this period, meetings of the consultants took place fre- 
quently, at first weekly, then bi-monthly, to clarify their own under- 
standing of the details of the four teaching methods; to plan uniform 
workshop and supervisory activities; to solve problems in a uniform way; 
and to select appropriate books and materials for all four variables. 

The isseivice workshop continued through the instructional period, at 




first once every week, later one session every two weeks. After twelve 
centralized sessions, lnservice training sessions alternated between one 
monthly city-wide meeting for each variable and one monthly district 
neetiag, led by the district reading consultants. The CRAFT assistant 
director made 24 all-day school visits, and the reading coordinators de- 
vote? minimally a half-day each week to the four CRAFT teachers in each 
of their CRAFT schools. Periodic meetings were held with the principals 
and district superintendents. 

The research staff was busy throughout the instructional period. 
E?ch of four research assistants made two OScAR-R observations, about 
two months apart, in each of the 48 classrooms.^ The teacher logs were 
checked and tabulated as they came in. Pretest scores were checked and 
entered on code sheets for later data punching. Census reports were 
checked for data on the school neighborhoods . Provisions were made for 
keeping track of the schools to which CRAFT children were being trans- 
ferred. School arrangements and schedules for final testing were pre- 
pared. Considerable time went into preparing a proposal for continu- 
ing and replicating the study. 

Final Testing Program 

By agreement with the other first-grade reading projects in the 
Cooperative Research Program, final testing of the CRAFT children was 
scheduled to begin the day after the l4o-day instructional period ended, 
namely on May 28; it continued for five school days, ending on June 4, 
1965. Both group and individual tests were completed during this period; 
makeups for absentees were arranged for the week of June 7 to 11. 

The group tests administered to all CRAFT children consisted of 
five subtests of the Stanford Achievement Test Primary Battery I : Word 
Reading, Paragraph Meaning, Vocabulary, Spelling, and Word Study; and 
the San Diego Inventory of Reading Attitude . 

Individual tests were administered to a randomly selected group 
of four children in each CRAFT class, a total of 192 children: Gilmore 

Oral Reading Test. Fry Word Recognition List. Gates Word Recognition 
Bistj Karlsen Word Recognition List . These tests were administered by 
the district reading consultant to the sixteen children in each school. 

In addition, two writing samples were elicited, one restricted 
to a stimulus established for all federal projects and the other stimulus 



For a description of OScAR-R and its use, see pp. 35 ff. 
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unique to our project. Both writing samples were administered in class 
groups, to approximate the conditions for writing to which the c hildr en 
were accustomed. Exact instructions for administering the writing sam- 
ples were distributed to the teachers, in order to keep variation down 
to a min imum . A copy of these instructions can be found in Appendix 
Only the compositions of the children tested individually were scored. 

Scoring the writing samples presented a considerable number of 
problems. Of particular interest was the problem presented by the three 
scores required by the Cooperative Research Program: (l) the Mechanics 

Ratio Scale which resulted from computation of errors in punctuation, 
capitalization and paragraphing; (2) the total number of words spelled 
correctly; and (3) the total number of running words. According to this 
procedure, a child who had written a series of correctly spelled words 
making no real sense would receive a higher score than a child who had 
poured forth a creative piece, atrociously spelled. An attempt at solv- 
ing this problem was made by adding a ’’lucidity” or "coherence” score 
ranging from 1 to 3, resulting from the judgment of three independent 
scorers. Another problem resulted from the fact that the criteria set 
down by the Cooperative Research Program included some s ki lls which are 
not taught in the first grade in New York City, for example, comma be- 
fore quotation marks and indentation for paragraphing. Nevertheless, 
CRAFT writing samples were scored as directed. 

End of Year 

The last inservice session of first-grade teachers was held on 
June 7. This "party" was planned as an opportunity for motivating the 
replication study and for consolidating knowledge about teaching method- 
ology in each of the variables. A fairly extensive display of child- 
produced materials was arranged. The major part of the meeting was de- 
voted to a series of colored slides showing selected, characteristic 
aspects of each method as developed in the CRAFT classrooms. These 
photographs had been taken by the audio-visual consultant, according 
to a planned list of scenes prepared at several consultants* meetings. 
Every CRAFT class was represented in the slide series and the teachers 
were delighted with the coordinated view of their work. 
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The closeness of the posttesting to the end of the school year 
made it difficult to complete the scoring, checking, recording, and 
punching of scores by the end of June. Accordingly one research assist- 
ant was employed in July to couple te this stage of the work. The statis- 
tical analysis and writing of this report occupied the Fall, 1965 semester. 

Experimental Precautions 



Avoidance of Hawthorne Effect 

Although one of the four methods of instruction— the Basal Header 
method— ecu. e closest to the way most of the teachers had been teaching 
reading, strong efforts were made to avoid giving the teachers in that 
variable the idea that they were in a "control" group while the other 
methods were "experimental." Seme of the precautions taken were: (l) all 

four methods were called "experimental"— the term "control group" was 
never used; (2) similar training programs were set up for all four vari- 
ables; (5) similar programs of visitation and consultation by the consult- 
ants were set up for all four variables; (4) meetings which brought the 
teachers in the four variables together were included in the training 
program, as well as meetings by variables. 

As a matter of fact, it was discovered that the Basal Reader method 
was partially new for the teachers assigned to it. Most of them had pre- 
viously used a combination approach in which they used experience stories 
and language-experience procedures until a substantial part of the pre- 
primer vocabulary had been learned, and then started the preprimers. Some 
of them had not paid much attention to the teachers' manuals— some had not 
even been supplied with manuals in the past. Several had never used the 
workbooks which were part of the basal reader series. Most of them had 
paid little or no attention to the suggestions for enrichment activities 
which were generally placed near the end of each lesson plan in the 
manual. So, for all of the teachers in this variable, teaching from the 
beginning of the first preprimer with close attention to the manual lesson 
plans, and utilizing the workbooks systematically, was at least partially 
a new method. 
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Despite these efforts, it became evident that the Audio- Visual 
and Fhonovisual variables seemed to the teachers and principals to have 
more "gla^r" than the other tiro variables. These were the tiro vari- 
ables that received considerable amount of new equipment and supplies 
and special instruction in the use of these additions. There is some 
doubt, therefore, that the efforts to eliminate Hawthorne Effect were 
completely successful. 

Equalization of Time: Teacher Logs 

The research staff considered it of utmost importance that time 
spent in teaching by the four experimental methods he equalized, in 
order to eliminate a source of considerable uncontrolled variance. A 
Daily Teacher log (see Appendix ) was therefore designed to record 
total time spent on discussion, listening, reading and writing in Social 
Studies and Science as well as in the Language Arts. The total time 
allotted to this combination was established as three hours a day for 
the 9 five-hour schools and 2-1/2 hours a day in the 3 four-hour schools. 

For teachers in the two Skills-Centered variables (Basal Reader 
and Phonovisual) , the following use of time was requested: 



Language Arts - Total 


5 Hours 
120 min. 


4 Hours 
100 min 


Reading (3 A) 


90 " 


75 " 


Other language Arts (lA) 


30 " 


25 " 


Social Studies 


30 ” 


25 " 


Science and Health 


30 58 


25 " 


Total 


18 q min. 


150 min 



The teachers in the Language-Experience variable^ with and without 
Audio-Visual supplementation, were asked to devote the same total time 
to the combination of Language Arts, Social Studies, and Science as the 
teachers in the Skills-Centered variables. Since, however, integration 
and' mutual reinforcement of the language arts (listening, speaking, read- 
ing, and writing) was a basic concept of the language-experience approach, 
the balance of time between reading and the other language arts was left 
flexible . 

Concerning audiovisual experiences, it was pointed out that these 
experiences are planned as part of the instructional program of language 
Arts, Social Studies or Science. They should, therefore, be included in 



* 

the tine allotasat unless sp^ficslly o&tside of the esperissntal vari- 

able, e. g., arithmetic. 

^en trips were made* time spent in prermretios before the trip 
and in discussion and fo.Uov-un activities were counted in the relevant 

curriculum area, but time spent outside the classroom was not counted. 
Number of Logs 

Teacher Logs -ere recorded every day in Noveabcr and December. 
At this point, tbe number of logs was induced to five consecutive days a 
ssonth, for two reasons: (l) the teachers expressed some resentment 
against recording every day; (2) the research staff judged that five a 
isonth would be adequate for the necessary statistical analysis concern- 
ing equalization of time. Fne teachers continued to submit logs through 
the month of May. 

Of all the extra jobs that teachers in the project had to do, 
the one to which they objected most was keeping the log. After listen- 
ing to tneir complaints, the log-keeping was cut to one week each month, 

for five months, starting with .January. Most of the teachers dutifully 
filled out the logs. 

Format of the Log 

The following activities were included in the log: 

Heading Activities ; 

Basal Reader Activity, Experience Chart, Sight Word Brill, 
Phonic Activity, Other Reading Activities (Specify) 

, Supportive Activities : 

Story telling or reading (by teacher). Discussion, Writing, 
Audio-Visual activity, A-V with intermittent discussion. 

Dramatization, Art work with reading. Other Language Arts 
(Specify) 

For Basal Reader and Phonovisu al; 

Social Studies, Science 

The curriculum areas of Mathematics, Music, Art, and Play Acti- 
vities were not counted in the project’s time budget, even though some 
of the time spent in them involved verbal communicatior . It was assumed 
"hat time spent in these areas would be fairly well equalized among the 
variables ard would therefore cancel out. 
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There is, of course, no way to verify the factual accuracy of 
the times entered by the teachers. On the other hand, the consultants 
had many discussions with the teachers on the use of time, and made 
many classroom visits. They found nothing to indicate that any teacher 
was intentionally misrepresenting her use of time in the logs. The xog 
seemed to be quite useful as a kind of personal feedback device which 
kept the teacher aware of her use of time. Teachers who found that 
they were using too little time, or too much, tended to correct that 
in later days of the same week. 

Checking, totalling, and doing statistical computations on the 
log forms proved to be a very time-consuming activity, absorbing a large 
amount of research assistant time. Nevertheless we believe that it was 
a worthwhile device that helped the teachers to come closer to uniformity 
in instructional time than they would have without it. 

The OScAR-R 

The presence on our staff of Donald M. Medley, who had been de- 
veloping objective ways of recording teacher behavior for several years, ^ 
was responsible for the development of a new observational procedure 
which he named OScAR-R (Observational Scale and Rating— Reading) . 

OScAR-R had a two- fold purpose: (l) to provide some record of 

the degree to which teachers in the experiment implemented the variables 
assigned to them; (2) to procure information about similarities and dif- 
ferences in the behaviors of teachers assigned the same method. If such 
behaviors should affect the rate at which pupils learn to read, this 
information would be used in the analysis of the data to increase the 
precision of the methods comparisons. 

The schedule had two sections, cne printed on the front and the 
other on the back of a five-by-eight card. One side was called t/ie 
’’Static 1 ’ section (OScAR Rs) and the other was called the ’’Dynamic” sec- 
tion (OScAR Rd) . The Static section was designed to yield a description 
of the range and variety of activities and materials observed in the 
classroom, analogous to a still photograph. The Dynamic section, which 
focused on the verbal behavior of the teacher, was designed to yield a 
description of the pattern of teacher statements and of the verbal inter- 
changes between teacher and pupils. The categories into which 'behaviors 

^ uedley, Donald M., and. Mitzel, Harold E., "Measuring Classroom Behavior 
by Systematic Observation,” Chapter 6 in Handbook of Research on Teach- 
ing, edited by NHj. Gage. Chicago: Rand McNally and Co,, 19bT- 




ysre coded oa both sides were designed to involve only simple* no;- 

ev&lu&tive discriminations which can be made by relatively unsophisticated 
observers after a brief period of training. 

The basic unit of observation is a ten-minute period. During the 
first three minutes, behaviors are coded on the Static side. During the 
next seven minutes, behaviors are coded on the Dynamic side. Three ten- 
minute periods are included in each observation. 

Visits were scheduled ahead of ti^e, and teachers were requested 
to arrange their school days so that a language arts lesson would be in 
progress while the observer was in the classroom. 

Dr. Medley, with the assistance of Lou Hicks Smith, worked out 
two sets of scoring keys intended to be useful in checking the degree to 
which there were real differences among the four vt '-iables . One was a 
set of a priori keysy^ based on a knowledge of what materials the teachers 
in each variable were supposed to be stressing. The other was a set of 
"empirical" keys, based on analysis of a fourth ten-minute set of observa- 
tions. These keys were based on the three-minute "Static" part of the 
observation. 

The ^Dynamic" part of the record used a technique similar to those 
employed in previous OScAR’s. Teacher verbalizations were categorized 
into "statements" and "interchanges." Each of these had several sub- 
categories which classified the remark as "meaningful" or "drill,” and 
rated its motivational quality. Whether the "Dynamic" scores would show 
any relationship to pupil achievement was a subsidiary research question, 
added to the original research design. 

An observational schedule was planned in which each teacher was 
to bo visited twice by each of four research assistants, making a total 
of eight 50-minute observations per teacher. Although there were many 
appointments that had to be rescheduled, nearly all of the planned obser- 
vations were carried out. 

Teacher reactions to these observations were quite interesting. 
The teachers in general welcomed class visits by the consultants and the 
project's assistant director, i*rho followed up their observations by dis- 
cussions in which they both commented freely about good features of what 
they had observed and offered construct ive suggestions about specific 
areas of weakness. They reacted quite differently to the observations 
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by the research assistants. They were bothered by the use of stop- 
watches, by the scribbling on a form they were not allowed to inspect, 
and most of all by the fact that they were never given any ccaasents by 
the research assistants. 

Provisions for Attrition of Pupils and Teachers 

In schools like the twelve utilized in this study, a high rate 
of pupil transiency is characteristic. In an attempt to Insure that a 
sufficiently large population would complete the experimental program, 
the number of pupils usually considered sufficient for reliable results 
was augmented by more than 50 per cent. The project began with over 
350 pupils per teaching method. 

Concern about possible teacher turnover caused us to request 
principals to give major attention to likelihood of staying for the 
full year, when enlisting teachers. Since only 2 of 48 teachers left 
the project before completion of final testing, this effort to minimize 
teacher turnover was highly successful. 

Effect of Teacher Experience with Method 

It was anticipated that there would be variations in the amount 
of familiarity teachers would have with the teaching method assigned to 
them, and that the teachers in the Language-Experience variables might 
take considerably longer to become competent in the specific method of 
teaching than the teachers in the Skills-Centered variables. 

Accordingly, it was hoped from the start that an opportunity to 
replicate the first-grade study would be found. It seemed probable that 
the teachers, in teaching a second class of first-grade pupils, would 
more fairly show what the method can do when used by a teacher trained 
for it and experienced in -it. 

Effect of Delayed Outcomes 

In the Skills-Centered variables a specific, restricted reading 
vocabulary is taught systematically and with considerable drill. In the 
Language-Experience variables major emphasis is placed on developing 
concepts and language facility, with a substantially smaller proportion 
of the total program spent on specific reading skills. 

It s earned reasonable to assume that the long-term effects of 
these approaches might differ from the short-tom effects. By the end 
, . the second and third grades -the delayed effects as well as the imme- 
diate effects should be apparent. Particularly uith disadvantaged 
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children. It seeded important to check, on fee delayed effects. Thus, 
before the results of the present study vere available, a request to 
folio? the children throng tvo sore years was made. 

The CRAJT Project staff from the beginning believed that the 
first-grade results would be suggestive but not conclusive, and that 
both replication and follow-up studies wouU be necessary before final 
conclusions could be drawn. 



The Teaching Methods 

* 

A brief description of the four teaching variables was given in 
Chapter I. It seeias desirable to describe the teaching procedures in 
greater detail, and also to describe the program of training and super- 
vision that was carried on in £ determined effort to get classroom proce- 
dures to conform to the teaching methods as described. The training pro- 
gram and the four teaching methods are described in Chapter IV. 




Chapter IV 
THE TEACHING METHODS 
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The Teacher Training Program 

Teacher training within the project was accomplished in sever- 
al ways: (l) by an ineervice training workshop; (2) by training with- 

in schools by consultants; (3) by training via the assistant director 
of CRAFT; and (4) by coordination through consultants and school admin- 
istration. 

In service Training Workshop 

Sessions of the centralized inservice course started on June 18 , 
1964, when the tea. hers frcsn all three boroughs convened for the first 
time at a central location in Manhattan. After meeting as a total 
group, the teachers met in four training groups, one for each teaching 
method. The workshop resumed in September, After September 10, 1964, 
when an all-day session was held, sessions were held on Mondays from 
4-5:30 p.m. There were twelve city-wide sessions. 

Starting in November, some of the training was shifted to dis- 
trict workshops which were led by the district reading consultants 
after centralized planning at CUNY. Time devoted to in service trail- 
ing remained equal for all variables. 

Training Within School by Consultants 

Equalization of training time t.us not attempted within schools, 
however. Reading consultants, who visited the CRAFT teachers in class- 
rooms in addition to meeting with them in groups, found that some 
teachers required more help than others in mastering the teaching method. 
In addition, the methods themselves were intrinsically unequal in new- 
ness to the teachers and in volume of techniques and technology to learn. 
The Audio-Visual variable, for example, required much instruction in the 
use of machines. In addition, audio-visual methodology related to 
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reading was in a state of on-going development . The teachers in the 
A-V variable thus required the help of an additional consultant, who 
was provided by the Bureau of Audio-Visual Instruction and confined 
his attention to A-V classrooms only. The Rionovisual method, al- 
though new to all of its teachers, was highly structured and was 
found to be relatively easy to learn. The Language-Experience teach- 
ers, although not required to learn new technology, found the tech- 
niques of that method difficult to master, and supervising them re- 
quired more time than supervising the teachers who followed the Basal 
Reader manuals. 

Training Activities of the Assistant Director of CRAFT 

Starting October 30, 19 64, the CRAFT coordinator spent a day 
at each school in turn, making the complete round twice during the 
year. Arriving at the opening of the school day, she observed all 
four classes for one-half to three-quarters of an hour each. At a 
luncheon meeting with the four teachers (frequently with the prin- 
cipal or assistant principal and reading consultant also) she dis- 
cussed frankly and openly the degree of adherence to variables, as 
well as teaching practices generally. In the afternoon, she either 
filled 3n additional observations or carried on discussion with in- 
dividual teachers or supervisors. The teachers appeared eager to 
receive help, asked questions, and raised problems they had encountered. 

( Some of the problems which were taken up during these day-long 
training-observations are: (l) the tendency of some teachers to spend 

time disciplining, in the expectation that children must sit still in 
order for learning to proceed; (2) the inadequate size of some of the 
instructional material: pictures, flash cards, etc.; (3) the tendency 
to do whole-class teaching of a nature v .hai requires much of the class 
to listen, without anything to do; (4) the tendency to use workbooks 
and other seatwork to keep children quiet rather than as meaningful 
reinforcement of learning; (5) the need for kinesthetic reinforcement 
of learning- --the teachers required much discussion before allow- 
ing the children to write immediately; (6) the need for work in small 
groups; and ( 7 ) the need for individualizing approaches. 



Problems raised by teachers at these sessions included the 
following: 

1. Some objected to the "readiness" period. The 20-day delay in 
starting the teaching of reading had been responsible, they felt, for 
loss of the opportune moment for enthusiasm for reading, resulting in 
diminution of motivation to read. 

2. Many teachers reached for precise instructions, wanted to be told 
exactly what to do. This dependence on supervision varied from teacher 
to teacher and tended to diminish as assurance in the variable developed. 
5. The length and rigor of the pretesting program upset many of the 
teachers and caused some temporary alienation from the project. 

4. In some of the schools, particularly those housed in new buildings, 
teachers complained of lacking necessities for language- experience 
materials, toys, primer typewriters, even general supplies. CRAFT pro- 
vided sentence strips and experience- chart pads to supplement the 
school supply of these materials. 

5. In sane schools, a full supply of basal reader materials was not 
made available immediately; delays were experienced in obtaining work- 
books and manuals. 

6. Audio-visual ceachers complained about delays in the receipt of 
equipment and in instruction in its use. 

Coordination Through Consultants and School Administration 



In order to administer the teacher training program success- 
fully and with as little variation as possible, planning of the train- 
ing techniques, philosophy and methodology had to be centralized. 

This coordination was accomplished by means of frequent meetings of 
the four reading consultants, the audio-visual consultant, the early 
childhood consultant, and the liaison elementary education consultant 
at the headquarters of The City University. All-day planning sessions 
were held weekly at first and later every other week. 

After plans for teacher training were set do#s for all four 
variables by this group, the reading consultants assumed a dual role: 
(1) They maintained on-going help and supervision of the CMFT teachers 
within their districts; and (2) Each one became an "expert” in one of 
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the four variables, so that she could teach the other three consult- 
ants the intricate details of the method, prepare training materials, 
and 3ead the city-wide workshops for her particular method. The 
reading consultant who undertook to become expert in the A-V method 
met monthly with the CRAFT coordinator and representatives of the 
Bureau of Audio-Visual Instruction to explore improved ways of utilizing 
A-V technology to teach reading. 

The cooperation of school principals and their assistants as 
well as of the superintendents of the districts in which CRAFT schools 
were located was actively solicited, since it was important to the suc- 
cess of the project. Periodic meetings of two kinds were held with 
this supervisory personnel: (l) Mrs. Helene Lloyd, the assistant super- 

intendent in charge of Elementary Reading, convened city-wide 
meetings of all administrative participants in CRAFT; and (2) The CRAFT 
director and assistant director visited the district offices, where the 
superintendent and his CRAFT principals, and often assistant principals, 
would convene for discussion of CRAFT problems. The assistant director, 
when visiting schools, conferred with principals concerning the pro- 
gress of CRAFT within each school. In addition, minutes of all consult- 
ants’ meetings were distributed to principals, assistant superintendents, 
and actively participating Board of Education personnel. 

The B asal Reader V a riab le 

In planning the details of the Basal Reader variable, the in- 
tent was to help the teachers come as close as possible to the instruc- 
tional practices intended by the authors and built into the reading 
materials and teachers’ manuals. 

Materials 



A typical basal reader series provides the following materials 
for the first grade: 

■r 

one or more reediness books (not used in CRAFT) 
three preprimers (thin, soft-covered books) 
a primer (first hard-cover book) 




a first reader (second hard-cover book) 
workbooks to accompany the preprimers, the primer, and 
the first reader 

a teacher's manual for each book in the series 
a set of cards or cardboard strips, each with a word, 
phrase, or phonic element printed on it 
There may be additional materials, such as a review preprimer, 
a supplementary primer, supplementary story booklets, correlated film- 
strips, etc. For the CRAFT Project "complete materials" was defined 
as including the preprimers, primer, first reader, workbooks, card set, 
and manuals. 

Most first-grade basal series c«n*er their stories around a 
single family, who live in a comfortable, middle-class suburban en- 
vironment. The CRAFT intention to use multi-ethnic, urban- centered 
basic readers was defeated by the unavailability, in September, 1964, 
of a complete first-grade multi-ethnic series. Three series (Scott, 
Foiccman Basic Readers in six schools; Harper and Row "Alice and Jerry" 
in four schools; Ginn Basic Readers in two schools) already available 
in the schools were utilized. In the opinion of CRAFT research staff 
and reading consultants, these were sufficiently alike in content and 
methodology that they could be considered to constitute a single teaching 
variable. 




A typical basal reader teaching plan contains the following 

steps: 

A, Preparing for the story 

1. Motivation and arousal of interest 

2. Introduction and explanation of new concepts, ideas, 
and meanings 

5. Oral and visual presentation and preteaching of 
new words 

B* Guided reading and rereading - 

1. Supplying a motivating question for reading ahead 
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2. Silent reading to find the answer 

3» Discussion of the answer 

k. Oral rereading, to satisfy a variety of purposes 

C. Developing specific reading s kill s 

l. Word recognition drill 

2. Training in. auditory and visual perception 

3. Bionics and other word identification skills; 
part of this is teacher- led from specific plans 

in the manual; part depends on use of the work- 
book 

Exercises to develop specific comprehension skills 

D. Enrichment 

1 . Dramatization or art work based on the stoiy 

2. Stoiy-telling or story- reading by the teacher 

3. Related musical selections 

4. Picture and story books related to the theme of 
the story for independent use by pupils 

5. Poetry, jingles, and rhymes 

Preliminary discussion with the BR teachers disclosed that 
none of them had previously followed closely the lesson plans in the 
manuals. Most had used experience stories before starting the first 
preprimer. Some had never received copies of the manual and had de- 
vised their own teaching plans. Some had rarely gone beyond the oral 
rereading step, and had made little or no use of the manual suggestions 
for developing specific reading skills, and the suggestions for enrich- 
ment. Some had nearer taught in first grade previously. 

In the workshop ioi BR teachers and in supervisory visits, 
emphasis was placed on using the BR material as intended by the authors 
For <"11 of the BR teachers, except those who had never before taught in 

first grade, this involved some departure from their previous teaching 
procedures , 



The Phonovisnal Variabl e 

The Fhonovisual Method is a step-by-step approach to phonics 
which can be used as a supplement to any method of teaching reading. 
The Washington, D. C. school district, which has been coping with the 
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problea of teaching large masters of disadvantaged children, had re- 
ported considerable success with the Phonovisual Method used as an ad- 
junct to the basal reader approach* In the CRAFT Project the Phonovisual 
Method was also used with basal readers, as the second of the Ski 11s- 
Centered variables. 

The Phonovisual teachers were instructed to use the basal readers 
for silent and oral reading. They were to follow the directions in the 
manuals for preparatory activities, for guided silent and oral reading, 
and for enrichment suggestions. The manual suggestions were to he 
utilized for introduction of new vocabulary and concepts and for the 
development of comprehension skills. However, the teachers were to omit 
those parts of the manual lesson plans that involved the teaching of 
phonic and structural analysis skills, and to use the Phonovisual method 
instead. 

There are three main steps in the Phonovisual method. First, 
consonant sounds are taught in the initial position, with the rest of the 

word indicated by a line, e.g., b Each consonant is associated with 

a word, e.g., £ig sound, wheel sound, fan sound. In the second stage, 
initial and final consonant sounds are both treated, with the line 

remaining to show the absence of the middle sound, e.g,, b t for beet . 

Third, vowel sounds are inserted into the middle position, starting with 
the long ee sound, e.g., beet . Short vo els are taught, returning to 
the remaining long vowels as the last step. In this third step, 29 con- 
sonant blends are taught by asking how many sounds before the vowel and 
how many sounds after the vowel. Finally, the children are taught to 
distinguish between ’'sound*' words, which follow phonic rules, and "study" 
words, which do not conform to rules alreauy learned. 

The several workbooks provide variety and repetition to amplify 
teacher- led lessons. Writing is an integral part of the method. There 
is a good deal of writing of sounds from teacher dictation. For example, 
at an early stage the teacher says "Write the way pig begins, wheel legins, 
fan begins. The teacher dictates a number of words beginning with the p sound, 
wh sound and f sound, and asks the pupils to write the sound with which 
the word begins. 

The materials supplied to the Phonovisual teachers included: 

I* Cne copy per class 

A consonant wall chart 
A vowel wall chart 
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Consonant Flipstrips ) illustrated letter charts for use 
Vowel F3 ipstrips ) &s flash cards or on flannelboard 
Pnonovisual Gamebooks for teacher use 

Fhonovisual Method Book (Schoolfield and Timberlake, 1963), 

a teacher* s manual 

II. Material for each pupil: 

Fnonovisual Readiness Book 
Phonovisual Transition Book 

Fhonovisual Skill Builders (a set of the 26 letters of 

alphabet) 

Fhonovisual Consonant Workbook 
Phonovisual Vowel Workbook 

Small reproductions of the consonant and vowel charts. 

One of the CRAFT reading consultants spent five days in Wash- 
ington in July, 1964, attending a workshop on this method. When she 
returned, she taught the other consultants, all of whom became pro- 
ficient enough to supervise the Phonovisual teachers in their dis- 
tricts. However, the 12 centralized inservice training sessions were 
led by the consultant who had received the specialized training. A 
Phonovisual motion picture, showing the method in use in an experi- 
mental school, was utilized in these training procedures. 

The Language-Experience Variable 

Since the Language-Experience teachers had much to learn in 
connection with both the theory and the practice of this approach, 
there was a lapse of time before some of them became effective in 
this variable. The concept of oral communication leading to written 
composition which was to be used as basic reading material appeared 
to be difficult for them to put into practice. The idea of speech 
wr itten down as the basis for reading hao to be mastered by the 
teachers before they could use this approach in the classroom. After 
they had mastered this technique in connection with short captions 
for drawings, paintings, and other original class productions, they 
had to learn first to produce single experience stories and then to progress 
to a sequence of experience stories reproduced in book form for the 
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children to read. The time it took to become an effective Language- 
Experience teacher varied greatly according to the flexibility of the 
teacher . 

Teachers were encouraged to start with individual words, and 
to move to phrases, sentences, whole charts, and finally to complete 
consecutive stories. Some few teachers moved comfortably and flexibly 
within the size range of language units without this sequential ap- 
proach . 

The very idea of what constituted an experience presented a 
problem, since many teachers had the notion that experience charts 
stem only from trip experiences . 

The following sources of children's oral production of language, 
to be written down and used as a basis for reading, were stressed as 
expeii ences: 

1. Individual verbal productions 

(a) Telling about realia brought into classroom to share with 
classmates 

(b) Relating of personal experiences which had occurred at home 
and on the street 

(c) Talking of hopes, aspirations, problems, reactions 

(d) Extemporaneous verbalization among children while by them- 
selves 

(e) Words elicited as important to the child, words "I’d like 
to read and write." 

(f) Telling the teachers about art production: painting, draw- 

ing, clay work, etc.; intensely personal "free" art expres- 
sions, or group production about a "core" subject 

2. Group verbal productions 

(a) Planning for class experi 

(b) Recalling and evaluating class experiences, from visits within 
the school building to long trips 

(c) Discussing books, science experiments, social studies learn- 
ing 

(d) Discussing intra-group, inter-personal problems, arguments, 
ways of behaving, etc. 
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(e) Discussing stories read to the pupils, heard on records 
or tape, or seen on filmstrips 

(f) Discussing holidays and seasons of the year 

(g) Discussing class pets and class plants, their care and 
characteristics 

(h) Planning classroom routines and assignments 

(i) Birthday parties 

W walks in the immediate neighborhood, discussing 

the differences in what one sees during the four seasons 
on the same block 

After the Language-Experience teachers had mastered the idea 
of how to translate experiences into language and then into reading 
materials, observing the world around them so that they could teach 
the children to verbalize about their total environment, methods of 
teaching reading from these experiences had to be taught in detail. 
Teachers requested specific suggestions for ways of developing sight 
vocabulary and word analysis skills, both phonic and structural. 

They needed help particularly in providing for repetition and rein- 
forcement of learning, since they had heretofore depended heavily on 
the repetition provided in the basal readers to which they were ac- 
customed. Many devices were created, such a*? class and individual 
hand-made tachistoscopes, word trees and a variety of games; repeti- 
tion of basic vocabulary was also built into the experience stories. 

The L-E teachers' need for structure in phonic teaching was 
so great that & workbook was selected, Basic Goals in Spelling, Book 1 
(Webster Division, McGraw-Hill Book Co., 1964), for use in the L-E 
classes. The teachers were instructed not to use this workbook se- 
quentially, but to use it for word recognition skills when the need 
and opportune moment for learning each skill arose. For example, 
when enough words such as blooms, buds, blossoms, and bushes, had been 
perceived auditorily, the visual modality would be introduced, and 
then the pages in the workbook that provide practice on that consonant 
would be used for reinforcements 

How to prepare experience charts was a study in itself. To 
assist in mastering the technique of constructing charts, the L-E 
teachers were given copies of Using Language Experience Charts with 
ChUdren, (Columbus: Charles E. Merrill Books, Inc., 1964). 




For aid in planning experiences within the classroom, copies of 
Listening Aid Through the Grades and Reading Aids Through the Grades , 
both by David Russell (New York: Teachers College Bureau of Publica- 
tions), were provided. 

Experience charts were thus composed on the basis of a series 
of experiences, around which concepts were first formulated orally by 
the children, then written down in their own words, and used as read- 
ing material. Many of cbe charts concerned direct life experiences, 
such as stories about the progress of a turtle or a plant; some charts 
dealt with vicarious experiences, such as discussions of books read to 
the class. Some of the booklets represented dramatizations emerging 
from puppet play. Some were individual productions, bound together 
as a class book, consisting of a drawing or a painting done by each 
child, with his caption or story printed below the illustration. Some 
dealt with water, electricity, or changes of season, and some with the 
classroom, school, or neighborhood. Some class charts evolved from 
reactions to emotional or sensory experiences, such as listening to 
music, talking about zoo sounds, or tasting foods cooked in the class- 
room. A good brunch was a favorite activity, involving shopping in 
the neighborhood stores, cooking, setting tables, eating, and cleaning 
up. All of this early verbalization and written production was accom- 
plished by group oral dictation to the taacher . Reproduction of the 
charts into book form was done on a primer typewriter or by teacher 
manuscript printing, each copy illustrated by the individual child. 

Much thought and discussion went into the handling of the oral 
language of the children. Since dialect usage and unstandardized 
grammar represent the usual mode of speech of these children and their 
families, it was decided, that complete acceptance of their verbal pro- 
duction would be the first step; correction of poor usage and grammati- 
cal form would come later. This decision resulted in a procedure which 
was dubbed ’’parallel charts.” The first chart reflected the exact 
words of the child and might read: ”The turtle gone into his shell. 

We seen him move in the water.” The parallel chart would emphasize 
"school language” (standard usage), and ree * "The turtle went into his 
shell. We saw him move in the water." Thus, phonic principles were 
not violated by writing "went" when the child said, "gone," or "saw" 
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rhen he said "seen." This system had a further advantage of accept- 
ance rather than rejection of the communication style of the child 
at the outset. 

After the cliildren had become accustomed bo charts written 
by the teacher, the next step was copying the chart by the children, 
an important transition stage, in which many classrooms remained for 
a considerable part of the year. 

The third step, the leap into creative (or at least independ- 
ent) writing, was accomplished more easily by seme teachers than by 
others. When children returned from a trip to the park, or a walk 
around the block, class discussion would be shaped so that each child 
could write about the experience independently at his seat, while 
some few wrote at the board. Flat pictures, one for each child in 
the class, were also used as stimuli for independent writing, done 
in small groups under the guidance of the teacher. Booklets of crea- 
tive writing by each child were shared with others and provided mater- 
ial for the transition into reading of trade books . 

Although not a necessary outcome of the method, individualized 
reading did appear to the research staff and the reading consultants 
as a logical step in the progression. The transition was facilitated 
by the purchase of five to ten copies of co-basal literature books, 
and primary level newspapers, as well as several copies of individual 
titles, preferably (for economy reasons), on paper-back editions. As 
a small group of children became competent enough to read these stories 
a short period of working together in the group was followed by branch- 
ing out into individual reading of books self- selected from a large 
group of trade books provided for the classrooms by CRAFT. Class 
libraries were built up further with the cooperation of school librar- 
ians. Use of neighborhood and school libraries for individual borrow- 
ing was encouraged. 

The Language-Experience. Audio-Visual Variable 

On^May 8, 1964, a meeting of members of The City University 
research staff and of the Bureau of Audio-Visual Instruction (BAVl) 
was held, at which plans were made for the A-V variable . It was agreed 




that most of the A-V equipment should be in the A-V classrooms by the 
endjCf November. This ms to include for each A-V class: a phonograph, 
film-strip projector, a wall screen, a tape recorder, an overhead pro- 
jector, earphones, a connecting box, and sharing the use of a motion- 
picture projector, a Polaroid camera, and a Kodak camera. There would, 
in addition, be access to a Thermofax copier for reproducing materials. 
Materials in each room would include film-strips, tapes, transparencies, 
and photographic film. GRAFT classes would also have priority in leas- 
ing l6 mm films from the classified lists. An annotated list of Ap - 
proved Audio-Visual Resources Applicable to CRAFT A-V Classrooms in the 
Language Experience Variable was later distributed to A-V teachers. 

It was agreed that the reading specialists would view all audio- 
visual materials before they were ordered for the schools, and that 
there would be a team approach to the project so that viewpoints and in- 
sights might be shared. Caution would be exercised against such mas- 
sive concentration of audio-visual materials that general applicability 
of CRAFT project procedures would be vitiated because they would not be 
practicable in public school situations in New York City. 

In planning for the preparation of special audio-visual mater- 
ials for each A-V classroom, it was agreed that such local material 
would be coordinated with the language-experience approach of the pro- 
ject and would ha^e relevance to the experiential base of the children 
and to the accepted rationale for concept development in each L.E. ex- 
perience classroom. 

If the physical aspects of the room permitted, every classroom 
was to have a viewing corner and a listening corner. The equipment in 
the vievdng corner would be a film-strip projector, wall screen, the 
overhead projector, and the motion picture projector. The equipment in 
the hearing corner would be the phonograph, the tape recorder, the ear- 
phones and the connecting box. 

BAvT' s contribution toward the development of local subject 
matter material would depend on the interest, the social background, 
and the language of the children, and would be used to bridge the gap 
between the level of their language and book materials. Constructing 
new materials based on the culture and language of the children would 




be useful in their transition to standard English. The children’s 
own writing and art would be used as much as possible in producing 
audio-visual materials to elicit verbalization which would be used 
in the first steps of reading. 

The role of the A-V consultant was planned to include the 
following functions: (l) to help the project teachers and reading 

consultants learn the capabilities of the machines and to train them 
in their utilization; (2) to provide consultative and advisozy ser- 
vice; (?) to coordinate “back-up” services, for example, priority in 
the leasing of 1 6 mm films, tape duplication, special graphic effects 
and maintenance and repair of machinery; (4) to promote confidence 
and skill in the operation and use of the A-V materials and equip- 
ment; ( 5 ) to assist in the production of local materials as well as 
in their development and display; (6) to participate in selecting, 
ordering and requisitioning of A-V materials, supplies and equipment; 
(7) to engage in on-going evaluative procedures; and (8) to partici- 
pate in cooperative planning. 

Special meetings were held monthly, attended by the director 
and assistant director of BA.VT, the A-V consultant for CRAFT, the 
CRAFT assistant director, and the reading consultant who had been 
designated as the instructor for the A-V workshop. 

Since the A-V variable was new and opened up some interest- 
ing possibilities, this report will describe some of the innovations. 

TheOyerhead Prelector proved to be a flexible and useful 
instrument. Permanent transparencies were made, based on the basic 
vocabulary of each class as evolved from the speech of the children. 
Sources of this vocabulary were: (a) individual dictation about 

drawings or painting; (b) spontaneous verbalization as they narrated 
incidents in their lives; (c) class compositions about their experi- 
ences; (d) “organic” words, which the teacher elicited from the 
children as having special meaning for them — often emotionally toned 
words, which they wished to learn; (e) stories read, or told by the 
teacher; (f) discussion of current events (space travel, for example) ; 
and (g) discussion of TV programs. 

The children were able to v5.ew this “treasury of words" again 
and again on the overhead projector. The teachers either made their 
own simple transparencies or were encouraged to send their words 



weekly, printed on drawing paper 8-1/2 x 11”, preferably with attrac- 
tive children 1 s drawings for permanent, more finished transparencies 
to be made by BAVI. Some of the words were learned by the whole 
class and some were for particular children, as individual develop- 
ment was encouraged. Transparencies were also .made with phrases and 
sentences. Experience stories that had been printed on charts were 
later put on transparencies and used for group reading. The same 
stories were also assembled in small booklets. 

Phonic and structural parts of words were printed on trans- 
parencies as children watched. Exercises designed to drill sounds of 
individual letters were done at seats and reinforced by work on the 
screen. 

In essence, transparencies were used for instruction in place 
of the chalkboard, to capture and hold the children's attention and 
to vitalize learning. A child would work with the teacher at the 
overhead projector; mistakes were corrected, and the correction was 
visualized on the screen as the rest of the class watched. Words 
flashed on the overhead projector were studied by the children to 
note the likenesses and differences, initial and medial sounds, etc. 

Children's pictures, transferred to transparencies, were the 
basis of discussion of lessons in noting details, predicting outcomes, 
seeing cause and effect, sequence of ideas, etc. 

Tape Recorder . 

The use of the tape recorder was developed in nu m erous ways. 
Th- children were encouraged to talk into the microphone, to record 
their own voices in discussing a story just heard, a picture, a film- 
strip, a movie, or an incident in their lives . They participated in 
language activities, telling hew snow felt and looked, how rain made 
rivers in the cracks of the school yards, hew autumn leaves crunched 
underfoot and blazed in the trees. They discussed their ambitions. 
They talked of a story hour at a local library. They described street 
sounds, horns, the screeching of brakes, sirens, motor noises, school 
sounds, sounds heard during a visit to the zoo, sounds of animals, 
machines, etc. 
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Also recorded on tape were original stories and rhymes by 
the children, and talks by community helpers, the fireman, the doc- 
tor, the letter carrier, etc. These verbal formulations were writ- 
ten down and used in reading charts from which oft-repented words 
were selected for reinforcement as w sight words." 

Listening to their own tapes often elicited from the chil- 
dren shocked reactions to their own speech, as well as spontaneous 
correction. Thus the tape recorder provided motivation for clear 
speech and an instrument for improvement of oral production, as 
well as a medium for the production of reading material in the idiom, 
rhythm, and specific speech pattern of the child. 

Earphones 

Earphones were used for individual or small group listening 
experiences. On the theory that slum children are conditioned to 
block out noise and conversation, CRAFT incorporated into the A-V 
variable a strong emphasis on listening. A maximum of six children 
could use the earphones at one time. 

Importance of Speech Patterns and Dialects 

.v: 

Since the A-V variable included use of a tape recorder for 
recording the speech of the children, what to do about idiomatic 
language and dialect speech became an important consideration. The 
use of audio-visual devices was intended first to produce participa- 
tion and communication in the form of verbalization, without atten- 
tion to deviant speech patterns. 

It was decided to make correction of poor speech patterns and 
dialect language a second step, since in the earlier stages, such cor- 
rection might be interpreted by the children as rejection. Ego devel- 
opment was considered an important goal, in addition to language 
development . 

Thus their own available tape recordings as well as popular 
children’s stories on phonograph records, made to accompany film-strips 



held their interest for relatively long period.?. They used the ear- 
phones, too, to follow stories in books, using a marker and follow- 
ing the words on the printed page as they were spoken through the 
phones « 



Cameras 



A Polaroid camera and a small Kodak were available to each 
pair of A-V classrooms . These were used to illustrate experiences 
such as playground activity, walks in the neighborhood, visits within 
the school. They were also used to record what was seen on trip s, and 
were instrumental in the stimulation of oral language and in expanding 
conceptualization • 

It was planned, as part of the A-V variable, to photograph 
such items as houses of different kinds, fruits, vegetables, animals, 
stories, clothes, and a variety of signals (for example, "danger,” 
"thin ice," "fire," "stop," "green," "yellow," "red"). An effort was 
made to go to first level of abstraction by massing individual items 
into a group or classification; for example, orange, apple, and avo- 
cado are all fruits; chair table, desk, cabinet, all furniture; etc. 

Phonograph Records 



In addition to the simple use of records in the development 
of listening skills, records were also used in several milti-media 
approaches. Recordings of stories accompanied both commercially- 
made film-strips and class-produced transparencies and experience 
booklets. Musical records such as Tubby the Tuba and Peter and the 
Wolf were made available as well. These were illustrated by drawings 
of the musical instruments put on transparencies and projected by 
the overhead projector, in an effort at concept and vocabulary 
development . 

Delay in Implementation 



Although it had been intended to have classroom A-V equip- 
ment substantially complete before December, delays in the filling 



t 
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of orders prevented this time schedule Area being carried out, and 
most of the A-V classrooms had gaps in their allotment until veil 
into January. As the different kinds of equipment arrived, the 
teachers needed training in hoe to use it for the benefit of read- 
ing instruction. It was not until February, therefore, that the 
A-V variable began to function as planned. Until that tine, the A-V 
classes functioned very much like the other L-E classes. 

A-V Newsletter 

A mimeographed A- V Newsl etter, prepared by the audio-visual 
consultant, was used for the exchange of successful A-V practices 
used by each teacher in the audio-visual variable. Since each teacher 
was encouraged to originate as many variations of methodology as pos- 
sible in connection with each piece of equipment, this exchange of 
ideas was an effective way of disseminating a great variety of prac- 
tices and of motivating creative thinking in this area. 

For the first three months of the instructional period the 
A-V classes differed very little from the other L-E classes. As the 
A-V equipment arrived and began to be used, the essential nature of 
the L-E approach remained, but the A-V procedures gradually were 

more and more for the presentation of both visual and auditory 
experiences . 
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CHAPTER V 
RESULTS 



The Pretest Remil f.« 



The Total CRAFT Population 



The feet that the CRAFT children tended to score loir on the national 
noms for the pretests giren in October was discussed in Chapter HT 
This wu shewn in Table 5, vhich was bwed on aU the children who com- 
pleted the pretests. Subsequently about 17 per cat of the children trans- 
ferred at of the school, in the project. The pretest score, of those who 
remained through the experiantal teaching period of l 4 o day. ad took all 
or aost of the final teats are euMorized in Table 14. 

Table Ik 

PBETEST RESULTS FOB TOTAL FTHAL POPULATION 



PRETEST 


N 


No* of 

Classes 


Moan 

Rev 

Score 


S.D. 


Range of 
Clans Means 


Percentile 
Rank of 
Mean 

Rav Score 


Hurphy-Durrell 

Phcmons 


995 


kk 


9.90 


8.56 


4.7 - 19.0 


1 


Capital Letters 


1007 


kk 


11.17 


8.63 


5.0 - 17.8 


23 


Lover Case Letters 


795 


55 


8.89 


7.21 


1.9 - 14.6 


26 


Total Letters 


795 


55 


20.31 


15.41 


6.9 - 53.0 


24 


Learning Rate 


1064 


46 


8.17 


4.03 


5.2 - 15.1 


44 


Metropolitan 


Word Meaning 


1124 


46 


5.25 


2.28 


2.3 - 7.8 


l4« 


Listening 


112 5 


46 


6.79 


2.58 


3.6 - 8.1 


03* 


Thnrstone 


Pattern Copying 


1062 


43 


2.69 


3.84 


0.5 - 5.7 




Identical Porr_ 


1102 


46 


5.36 


6.16 


0.8 - 13.4 





* Percentile rank, estimated. fr« th, n«n, s.D.'s giwen in thT^l'. 
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It may be noted that the znafoer of children on vhooi mean scores 
are based ranges from 795 to 1125 , and the number of classes represented 
ranges from 55 to ^*6. This variation is due to the fact; that the Morphy- 
Burrell Phonemes test was improperly administered in fair classes; the 
test of Lower Case Letters was either overlooked by the exudner or im- 
properly administered in 15 classes; and the Thurstonc Identical Forms 
test was not productive of usable data in two classes. Both reports from 
proctors and the internal evidence of the record blanks were considered 
in deciding not to record certain class sets of scores because of deviant 
administration. 

The pretest means of the final, population are all. slightly higher 
than those of the total pretest population, indicating that the children 
who left during the instructional period tended to come from the lower 
half of the distributions. This tendency is consistent for all nine of 
the pretests used. 

The danger of considering disadvantaged children to be homogeneous 
in their abilities is clearly shown by the standard deviations and ranges 
of class means. Of the nine S.D.*s, two are actually larger than the 
means (on the two Thurstonc tests), while four more (t furpby-Durrell ) are 
almost as large as their means. The variability among individual pupils 
was very great on those six pretests. The variations among class means 
were even more startling, as shown by the ranges. On the test with the 
smallest range (Listening) the highest mean was more than twice the low- 
est mean; on the test with proportionately the greatest orange (identical 
Forms) the highest mean was approximately fifteen times the lowest mean. 

The differences among class means become more understandable when 
it is recalled that in the majority of schools, two of the experimental 
classes contained random samples of the children with kindergarten exper- 
ience, while the other two classes were chosen ut random from among the 
children without kindergarten experience. In sous of the classes (parti- 
cularly in non-kindergarten classes) the examiners and proctors reported 
that many of the children did not seem to understand the standardized di- 
rections, even after the demonstration items had been completed. When a 
whole class is tested according to the standardized directions and a- 
chieves a mean licore of less than erne point, as happened on both Thurs- 
tonc cests, the fact that the test was unsuitable for that class is 




clearly demonstrated. The two Timrstone tests and the Phonemes test were 
generally reported to be frustratingly difficult for large segments of 
this population. 

Current norms based on the population of the 27 projects sponsored 

* 

by the U.S.O.E. Cooperative Research Program are given in the 1965 Manuals 
of the Murphy-Durrell Reading Readiness Analysis and the Metropolitan Read - 
iness Tests ; the data given in the two manuals indicate that the norms of 
the two tests were based on the same population (a total of 12, 231 children 
each) and thus are directly comparable. The CRAFT children seem to have 
comprised approximately one- tenth of this total normative population.* 

On the five Murphy-Durrell subtests and the two Metropolitan subtests 
that were used, the CRAFT children showed a very uneven pattern. They 
showed up most poorly on the Phonemes subtest, which is intended to measure 
ability to hear and distinguish consonant sounds within spoken words. The 
mean CRAFT score was 9*90, ranking within the bottom one per cent of the 
normative group. The highest CRAFT class on this test had a mean of 19*0, 
ranking at only the 8th percentile of the normative population. Practical- 
ly no CRAFT childr'an scored above the normative 50th percentile; the corre- 
sponding raw score of 57 is approximately three S.D.*s above the CRAFT mean 
of 9*90. Three possible explanations of this extremely low showing are: 

(l) inability to understand the language of the instructions; (2) marked 
differences between the pronunciation of test words by the examiners and 
the speech patterns to which the children were accustomed; and (5) lack of 
experiences that would provide preparatory training in auditory perception 
skills. 

The CRAFT children* s second lowest showing was on the Word Meaning 
sub test. The CRAFT mean rated only at the l4th percentile of the normative 
population. Rot one of the k8 CRAFT classes had a mean as high as the mean 
of the normative population. These findings confirm previous reports that 
disadvantaged Negro children are already quite retarded in vocabulary devel- 
opment when they enter the first grade. 

On four subtests— Capital Letter Names, Lower Case Letter Names, Total 
Letter Names, and Listening— the CRAFT means fell at the 23rd to 26th per- 
centiles of the normative group. The median percentile for the seven sub- 
tests was 23.5* 

* At the time this report is being written, similar dokm have not been made 
available on the two Thurston© tests. 



Ob on. aubtert, iuwaver, the CRAFT children did ccapratively well. 

TkU f * th * Learning Rate test, on which the CRAFT seen 

stood at the tttfa percentile Of the native population. This teat is 
essentially a standardized lessen in which nine words are taught by a 
look and say" technique. After an interval of an hoar, a 27-ltea recog- 
nition test i. given. The CRAFT naan of 8.1 7 «aa not auoh below the nozm- 

5001 («» score of 8.8). Coe CRATT class had a nean of 

15.1, ranking at thi 88th percentile of the normative population. 

If it can be assnaed that the learning Rate Test is aneasnre of ap- 
titude for leaning to recognize weeds by a sight or "look and say" nethod, 
the CRAFT population sew to be alaoet up to the national nora in this ap- 
titude. Thi s is in sharp contrast to their ertrenely low performance en 

the Thonoes test, a fact which should have sew relevance to readiness for 
phonic ini traction. 



Since it had been known in advance that there were subitanti&l dif- 
ferenees aaong the twelve school, in auch relevant data as neighborhood 
laew, neighborhood oducatiensl level, end standing on recent citywide 
wading teats, great care had been taken to work out a pattern for assign- 

° f “ rtl104 * t® and classes that would not he biased 

for or against any of the tsaehing aethods. Bach of the twelve schools 
had two skllls-esntered classes and two Language-Experience classes. The 
four possible pairs of teaching aethods (B.R. vs. L.B.; B.R. vs. L.E.-A.V.; 

a. vs. L.E.; Ph. vs. L.E.-A.T.) had been assigned to three schools each by 
a modernized nethod. Within sad: school, the classes were assigned to the 
two teaching nethod. in a my that balanced kindergartan-ezperienced classes 

and noc-kiodergarten-olaasea, but left to chance which class in a pair would 
be assigned to each Method. 



With twelve daaaes for each teaching nethod, and precautions against 
ias as listed above, it was hoped that the pretest results for the four 
aethods would be fairly evenly balanced. The Beans and S.D.'s of the nine 
Pretests are shown in Table 1 5 for the four teaching Bethods. While the 
differences were not trwndcua, the aethods were not evenly b& tweed. The 
B.R. group had the highest new on five of the tests; the L.E. group had 
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The Detroit Word Recognition Teat vat given in October, X9&, to the 
48 pupils whose teachers thought they had shown signs of some ability to read 
words* Of the 48, just half (24 children) made scores of 0, 1, or 2, which were 
considered to fall within the range of chance success* The other 24 pupils were 
evenly divided, 12 in Skllls-Centered classes and 12 in Language-Experience 
classes* In addition, their nean scores on the four pretests used in the co- 
variance adjustments were substantially higher than the means for the total pop- 
ulation* Their outcome measures were also substantially higher than those of the 
total population. Because Of the small number of early re*der»,tbe even mserical 
di vision between the two major approaches, and the tsovarlanee adjustments, it 
seems safe to conclude that ability to read at the beginning of the first grade 
did not differentially affect the outcomes of the teaching methods and approaches. 



Table 15 

PRETEST RESULTS FOR THE FOUR TJACHUO METHODS 







TEACHING 


MJB T H 0 D 




PRETEST 


I 

B.R. 


H 

PH 


• 


in 

L.E 


• 


17 




M 


3.D. 


M 


S«De 


M 


S.D. 


M 


S.D. 


Murphy-Durrell 


















Phonemes 


11.05 


9.51 


?.o6* 


8.07 


8*50 


7.33 


10.88* 


9.06 


Cap, Ltr. Names 


11.29 


8.67 


u.57* 


9*21 


10.28 


8*52 


11*72* 


8.95 


Lower Case Ltr* Names 


8.98* 


6*80 


8.93* 


7*18 


8.58^ 


7.25 


9.13* 


7*59 


Total Ltr* Nines 


21..43* 


14*92 


19.90* 


15.65 


19.03* 15.00 


21.01* 


16.06 


Learning Rate 
Metropolitan 


9*01 


4.27 


7.7s 


3 .67 


7.15 


3*72 


8.75 


4.12 


Word Meaning 


5.18 


2*21 


5.12 


2.25 


5.47 


2.21 


5.23 


2.42 


Listening 


6.95 


2.35 


8.79 


2.64 


6.68 


2.60 


6.75 


2.71 


Thurstons 


















Pattern Copping 


2.29 


3*57 


2.76 


3.69 


2*90 


4*02 


2.81 


4.24 


Identical Fozss 


4.64 


5*48 


5.52 


6*52 


5.72* 


6.40 


5.60 


6.18 


N (Final Populations) 


291 


2 85 


209 


278 



* Based on fever than 12 classes* 



the lowest seen on six of the tests* 

These rssults, together with the large differences in means of indi- 
Tidnal classes, indicated that it would he necessary to correct the outcome 
■easnres for initial differences in aptitude. The method chosen was analy- 
sis of covarimce* 

Ifltercarrelatloca among Pretests 

toe of the req uir eme nt s for correcting a set of class mesas by analy- 
sis of covariance Is that there most be a set of stores for every class on 
eedh pretest measure to be need. This alimtasted all of the pretests for 
which data mere missing on one or more olasseet four of the five Ifcrpfty- 
ftar**n seoree, and the Thorstone Identical Forms* Four pretests had us- 
able sets of scores for all 48 classes* These were the Murufar^Durreai 



“6s« 

I»OErr»ing 3&ti; Kstrogolltan Word Moaning end Listening, and ibiuvtoDi Pat- 
tern Copying. 



Table 16 



TMZB&ffiKAttOm AWm POOR pretests* 






TEST 


T E 


S T 




1 


2 


3 


4 


1. Murphy-DuiPrell Learning Rate 

2. Metropolitan Word 

5. Metropolitan Listening 
4. Thurstone Pattern Copying 


•12 


.21 

.34 


•22 

.25 

•22 



* madam N it 1062 



The intercorrelations among these four tests are shown in Table 16. 
They are consistently lew, ranging fro* .12 to .34. This indicates that a 
combination of the pretests is likely to produce better correlations with 
outcoae measures than any one pretest. 

Correlations between Pretests and Posttests 




The correlations between the four pretest noasures and the tests 
used as outcome noasures are Shown in Table 17. Since eliminati n g all 
c hildr en for Whoa any score was missing would have resulted in a loss of 
several hundred cases, each correlation was computed using orrery fc* 
whom both scores were available. Thus the number of cases varies. The 
correlations with subtosts of the Stanford are based on If* a between 1062 
and 1127. The individual tests had been administered to four childr en 
chosen at random from each class, giving 48 cases for each teaching method, 
96 cases for each approach, s_4 a total of 192 cases. 

An inspection of Table* 17 shows that nearly all of the r*s are low 
or very low. Only three of the 4o r*s are above .40. Hone of the four 
pretests had meh higher correlations than the other three. However, even 
lew correlations like these art usable In combination when the correlations 
among the pretests ere low. One multiple correlation was computed to check 



< 













Table 17 

IlfTEKKJRRHiASIO!© BETWGBU PRETESTS AND P0STTR3T3 







P R E T B 


STS 






M-D Learning 
Rate 


Metropolitan 
Wd. Mng. Lstng. 


Tburstone 
Pattern Cop. 


Stanford Achievement 1 


Word Reading 


•42 


.32 


.32 


.37 


Paragraph Meaning 


.36 


.27 


.32 


.35 


Vocabulary (oral) 


.25 


.36 


.32 


.29 


Spelling 


.30 


.25 


.27 


.32 


Word Study 


.29 


.33 


.36 


.35 


Gilmore Oral Reading 


Accuracy 


.37 


.32 


.36 


.29 


Rate 


•20 


•08 


.06 


.26 


2 

Fry Phonetic Word 


.53 


.17 


.15 


.09 


Gates Word Pronunciation .38 


.24 


.32 


.25 


Karlsen Phonemic Word 


.41 


.29 


•26 


•21 



A H « 1062 to 1127 
2 N « 192 



the desirability of using all four pretests, and case out with an R above 
.50. It was decided, therefore, to utilize all four of the available pre- 
tests in the covariance analysis. The correlations in Table 17 are based 
on individual pupil scores end are not corrected for covariance. They do 
not include the five pretests for which data were Biasing for one or nore 
entire classes. For those five tests, correlations with outcome measures 
can be found in Table V6. However, Table ^6 is based on class means cor- 
rected for covariance on the posttests, and is not directly comparable 
with Table 17* 



Results of the (Xxtcome Measures 



In order to adjust the outcome Measures for initial differences in 
pretest performance, a special computer program was developed for thi* 



! 
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Table 18 

AHALTSI8 QP COVARIAHCE, STANFORD WORD READING 




TOTAL 

ERROR 

CLASSES 



33734.130 

^707.032 



1000 

953 



7027.098 



47 



28.024 

1^9.513 



5.335 



P < .01 



Table 19 



AHALISIS OF CCVARIABCE, SIABFOM PARAGRAPH MEAHIHJ 



SOURCE 


SS 


df 


MS 


P 


TOTAL 

ERROR 

CLASSES 


♦ 

41513.250 

2l OaQ 9 *f%am 

• p2f 

10304.723 


1000 

953 

4? 


32.748 

219.249 


6.695 



P < .01 



The analysis of covariance table 
in Tables 18-22.* 



for the five Stanford subtests 



are shown 



«* data of 

able for inspection • aarch and Evaluation, and are avail- 



f-a «>• s >s>w» yyt . « ■ - * * 
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Table 80 

ANALYSIS OP COVARIANCE, STANFORD VOCABULARY 



SOURCE 


SS 


df 


MS 


F 


| 

if 


25092.661 

197 * 7.257 


1000 

953 


20.721 




CLASSES 


5345,604 


47 


113.736 


5.489 










P < .01 




Table 21 

ANALYSIS OF COVARIANCE, STANFORD SPELLING 




SOURCE 


SS 


df 


MS 


F 


TOTAL 

ERROR 


25355.269 

17885.922 


1000 

953 


I 8.768 




CLASSES 


7467.347 


47 


158.880 


8.465 










P < .01 




Table 22 

ANALYSIS OF COVARIANCE, STANFORD WORD STUDY SKILLS 




SOURCE 


SS 


df 


MS 


F 


TOTAL 

ERROR 


71279.371 

55755.099 


1000 

953 


58.505 




CLASSES 


1552*. 273 


47 


*nli 

✓y v t 


c OiiC 

ycww 



P < .01 



The F values for these analyses are all significant at the .01 level, 
indicating that after adjusting thi means of the 48 classes, significant 
differences remain* What these differences may be attributed to will be 
considered below. 

Insofar as background factors such as low family income, low parent 
education, and similar socio-economic conditions handicap a child in the 



development of the abilities needed for successful learning in school, 
they should affect the child’s performance an reading readiness measures 
as veil as in classroom learning. The data on pretests given above she? 
qjiite severely lav scores cm most of the pretests for the CRAFT popular 
tion as a whole. It seems reasonable to assume that when the posttest 
scores were adjusted for differences in pretest performance, adjustment 
vas being made not only for the specific abilities tapped by the te B ts, 
but also for the background factors which were somewhat variable frem 
school to school, and from child to child. 

It has been assumed, therefore, that in adjusting the posttest 
scores for differences in pretest scores, such background factors as pa- 
rental income and education, and neighborhood conditions have also been 
adjusted* 



Stanford Primary 



Th ® Stanford Primary 1 B attery, Form X, was published in 1964. It 
contains six tests, one of which (Arithmetic) was not given. The ocher 
five subtests wei.*e given to all the children in CRAFT classes. 

At this point, it seems desirable to describe these tests. The first 
is Word Reading. Each item consists of a picture and four words, one of 
which is illustrated by the jdeture and is to he marked. The task involves 
correct picture identification and the recognition of the pictured word 
without the aid of context. There are 35 items arranged in order of in- 
creasing difficulty. 

The Paragraph Meaning test consists of a series of paragraphs of in- 
creasing length and difficulty. In each paragraph one, two or three words 
are represented by dotted lines. For each dotted line, the child chooses 
the best fitting word of four choices offered. The manual states that the 
authors have attempted to emphasize "reading as reasoning." 

The Vocabulary subtest Is intended to measure knowledge of the mean- 
ing of words independent of reading skill. The examiner first reads the 
question, then reads the three choices to the children. The test is a 
measure of hearing vocabulary. 

The Spelling subtest is a conventional dictation-type test. The ex- 
aminer pronounces a word, reads a sentence containing the word, and repeats 
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the word. The children then attempt to write the word. 

The Word Study Skills subtest includes items intended to measure 
auditory perception of be ginnin g sounds, ending sounds, phonics (recogni- 
tion of spokes words), and rhyming words. 

Of tfc$ five tests, then, the Word Heading, Paragraph Meaning, and 
Word Study Skills tests measure aspects of reading ability. The Vocabu- 
lary test requires no reading ability, and the Spelling test measure a 
related language art skill. 

The adjusted mean raw scores for the twelve classes in the Basal 
Reader Method were combined to give a mean for the method. Similar means 
were computed for the other three methods. The two methods in each ap- 
proach were then combined to give means for the two main approaches. 

These means are shown in Table 23. On each of the five subtests 
the Skills-Centered mean was a little higher than the Language-Experience 
mean. Within the Skills-Centered Approach the Basal Reader Method had 



Table 23 

ADJUSTED STANFORD RAW SCORE MEANS FOR THE TWO APPROACHES 
AND FOUR TEACHING METHODS 





Skills-Centered Approach 


Language-Experience Approach 


B.R. 


Fh. 


Total 


L.E. 


L.E.-A.V. 


Total 


Word Reading 


lk.76 


15.46 


i 5 .ll 


12.93 


13.00 


12.96 


Paragraph Meaning 


13.31 


11.42 


12.40 


10.43 


9.90 


9.99 


Vocabulary 


15.95 


14.94 


15.45 


14.51 


14.50 


14.50 


Spelling 


8.38 


8.20 


8.30 


7.27 


7.32 


7.30 


Word Study Skills 


25 .C& 


28.30 


26.64 


25.38 


25.66 


25.52 



slightly higher means than the Phonovisual-Basal Reader Method on Para- 
graph Me anin g, Vocabulary, and Spelling, while the Phonovlsual Method was 
slightly higher on Word Reading and Word Study Skills. Within the Lan- 
guage-Experience Approach the means for the regular Language-Experience 
Method and the L.E. Audio-Visual Method are so similar as to be essential- 
ly equal on all five subtests. 

The statistical significance of these findings, and the separation 
of Method effects from other factors, will be treated in the section on 




analysis of variance below. 



A study of the tables of noxms for the Sta^ord Primary I indicates 
that several adjacent raw scores frequently result in the identical grade 
score. On the Paragraph Meaning Test, for example, raw scores of 10, 11, 
and 12 all have a Grade Score of 1.5; 13, l4, 15 and 16 correct answers 
all beccato 1.6; 17, 18, 19 and 20 all correspond to 1.7* Thus a Measurable 
difference in raw score means may disappear when translated into Grade 
Scores. 

Table 24 shows the mean grade scores corresponding to the mean raw 
scores in Table 23* The tot$l range of differences in the whole table is 
only two-tenths of a grade. In Vocabulary and Spelling the two approaches 
and four teaching methods are all equal. The Basal Header method has a 
slight advantage (0.1 year) in Paragraph Meaning, the Phonovisual-Basal 
Header method has a slight advantage (0.1 year) in Word Study Skills, and 
the two Skills -Centered methods have a slight advantage (0.1 year) over 
the two* Language-Experience methods in Word Heading. According to the 
Stanford results, differences among the methods seem to be of little prac- 
tical consequence, even when they are statistically significant. 

Table 24 

GRADE EQUIVALENTS OP ADJUSTED STANFORD MEANS FOR WO 
APPROACHES AND FOUR TEACHING METHODS 



Skixls-Centered Approach Language-Experience Approach 





B.R. 


Fh . 


Total 


L.E. 


L.E.-A.V. 


Total 


Word Reading 


1.5 


1.5 


1.5 


1.4 


1.4 


1.4 


Paragraph Meaning 


1.6 


1 *5 


1.5 


1.5 


1.5 


1.5 


Vocabulary 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


Spelling 


1.6 


1.6 


1.6 


1.6 


1.6 


1.6 


Word Study Skills 


1.4 


1.5 


1.4 


1.4 


1.4 


1.4 



Analysis of Variance: Word Reading c The results for each of the Stanford 
subtests were subjected to an analysis of variance designed for this pro- 
ject by Donald M. Medley. This allowed each of the following factors to be 
tested for possible significance in the obtained differences: (l) differ-, 

ences among the schools; (2) the SkiUs-Centered Approach vs. the Language- 
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Experience Approach; ( 5 ) Language-Experience method va. Audio-Yiaual Sup- 

dentation method; (If) Baaal Header method va. Phonovisual-Basal Reader 

od; ( 5 ) the particular pairing of methods in the four poaaible patterns 

(B.H. va. L.E.; B.H. va. L.E.-A.V.; Ph. va. L.E.-A.V.); (6) interact** of 

approaches, by schools; and (7) dess differencea within methoda (the re- 
aidual). v 

Table 25 

AKOTSIS OP VARIANCE, STANFORD WORD READING 



SOURCE 


df 


SS 


MS 


F P 


School Differences 


11 


95.941 


8.722 


2. 166 


LeE. VBe Skills -Centered 


1 


59.318 


59.318 


14.728 .001 


A.V. Enrichment (with L.E.) 


1 


8.330 


8.330 


2.068 


Hi. (with Skills-Cent ered ) 


1 


8.554 


8.554 


2.124 


Treatment Interaction with schools 


1 


l.m 


1.111 


.276 


Interaction, approach by school a 


8 


31.125 


3.891 


.966 


Residual (class differences within 
methods) 


24 


96.662 


4.028 


TOTAL 


k? 


3oi.o4o 







The results of applying this analysis of variance to the corrected 
daaa means on the Word Heading subteat are shown in Table 25. The only 
statistically significant difference i. that between the Skilla-Centered 
pproach and the Language-Experience Approach, which has an F value of 

Zl 3 — h “ 0,17 °“ cS “ nce • «“»““* being a dance result. This 
difference is already known to amount to only one-tenth of a year in grade 

score. Hone of the other possible interactions approaches significance. 

The residual attributable to class differences within methods i, quite 
large. 

VarUnee! Paragraph Meaning . The results on’ the Paragraph 
Meaning subtests are shown in Table 26. The only interaction that reaches 
statistical significance is the slight edge of the Skilla-Centered Approach 
over the Language-Experience Approach; the F value of 9,92 has a P < .01. 
Hone of the other Interactions approaches significance. The cl 
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Table 26 

AKALISIS OP VARIANCE, STANFORD PARAGRAPH MEANING 



SOURCE 


df 


SS 


MS 


F P 


School Differences 


11 


117.960 


10.726 


1.322 


L.E. vs. Skills-Centered 


1 


80.477 


80.477 


9.922 .01 


A.V. Enrichment (with L.E.) 


1 


.283 


.283 


.055 


Ph. (with Skills -Centered) 


1 


13.174 


13.174 


1.624 


Treatment Interaction with schools 


1 


7.073 


7.073 


C\J 

cb 

• 


Interaction, approach by schools 


8 


6 0.224 


7.528 


.928 


Residual (class differences within 
methods) 


24 


194.657 


8.111 


TOTAL 


47 


473.869- 







A n a lysis of Variance: Vocabulary . As was noted earlier, the Vocabulary 
subtest is not a aeasure of reading shill but rather a measure of listen- 
ing vocabulary. On this test all of the four methods came out with the 
same mean grade score (see Table 2*0 and none of the possible interactions 

in Table 27 approaches significance. The class differences within methods 
are again quite large. 

Table 27 

ANALYSIS OF VARIANCE, STANFORD VOCABULARY 



SOURCE 


df 


SS 


MS 


F P 


School Differences 


11 


21.297 


1.936 


.425 


L.E. vs. Skills-Centered 


1 


10.331 


10.331 


2.267 


A.V. Enrichment (with L.E.) 


1 


.968 


.968 


.212 


Hi. (with Skills-Centered) 


1 


2.450 


2.450 


.538 


Treatment Interaction with schools 


1 


1.652 


1.652 


.362 


Interaction, approach by schools 


8 


73.066 


9.133 


2.004 


Residual (class differences within 
methods) 


24 


109.392 


4.558 




TOTAL 


47 


219.156 







Analysis of Variance; Snrillnff. Spalling is a related language-art* 
skill on which differences would not have been surprising. In toms of 
mean grade scores there were no differences between the two approaches 
or among the four methods. It is not surprising, therefore, that the 
only significant interaction is among schools, with an F of 5.51 and 
P = . 01 . A probably significant interaction between Audio-Visual and 



Table 28 

ANALYSIS OP VARIANCE, STANFORD SPELLING 



SOURCE 


df 


SS 


KS 


F 


P 


School Differences 


11 


179.199 


16.291 


3.505 


.01 


L.E. vs. SkiUs-Centered 


1 


19.078 


19.078 


4.105 




A.V. Enrichment (with L.E.) 


1 


28.053 


28.053 


6.036 


.05 


Ph. (with SkiUs-Centered) 


1 


9.631 


9.651 


2.072 


Treatment Interaction with schools 


1 


.070 


.070 


.015 




Interaction, approach by scnools 


8 


29.176 


3.647 


.785 




Residual (class differences within 


24 


in .542 


4.648 




methods) 








TOTAL 


47 


376.750 









Language-Experience also shews up; with an F of 6. 04 and P < . 05 , its sig- 
nificance is not certain. Class differences within methods are once again 
large. 

A nalysis of Variance; Word Study Skin Although the Phonovisual-Basal 
Reader method was slightly higher than the other three methods in Word Study 
Skills mean grade score, this does not show up distinctively in the analysis 
of variance (Table 29). For this subtest there is a significant school dif- 
ference (P « 4.05, P < . 01 ) and also a significant difference between Skills- 
Centered Approach and Language-Experience Approach. The difference between 
Basal Reader method and Phonovisual-Basal Reader method is non-significant. 
Class differences within methods are again outstanding. 




X 
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Table 29 

AKALIBIS OP YARIAKI, 8TAXFOHD WORD SOTY SKILLS 



SOURCE 


if 


88 


m 


P 


P 


School Differences 


11 


342.870 


31.170 


4.047 


•01 


L.E. vs. Skills-Centcred 


1 


96*264 


96.264 


12.302 


,01 


A.V. Enrichment (with L.E,) 


1 


19*481 


19*481 


2.530 




Pb. (with Skills -Centered) 


1 


5.6o4 


3*6o4 


•728 




Treatment Interaction with schools 


1 


.238 


.238 


.033. 




Interaction, approach by schools 


8 


55*899 


4.487 


.583 




Residual (class differences within 
methods) 


24 


184.834 


7*701 






TOTAL 


47 


6 85.210 









Results of Individual Postteats 

In accord with the pinna for the 27 coordinated rjtudles of first- 
grade reading, individual reading teats were given to a Maple of four 
c hild ren fraa each class, chosen at random. This provided 48 scores for 
each nethod and 96 scores for each approach, a total of 192 children given 
the individual tests. 

It would have been single to report moans on this staple for the four 
methods and attenpt to determine the significance of the differences. It 
seemed necessary, however, to correct the class means for covariance before 
using analysis of variance. Attempts to use the covariance program with 
these data ran into many frustrations, wasted much computer time, and held 
up the completion of the statistical analysis for a considerable period of 
time. 

Successful covariance adjustments for two of tha individual reading 
test* were finally achieved aa shown in Tablet 30 and 31. After adjusting 
the means, the remaining differences are probably significant for the Gil- 
more Accuracy score (P « .05), which is a measure of accuracy in the oral 
reading of connected material. The residual differences for the Gates Word 
List are not significant. The Gilmore Bate, Pry Word List, and Karlaen Word 
List scores thwarted cur efforts to apply covariance corrections. 
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Table 30 

ABILXSXS OR C0WARXAI3E, GUJORE ACCGHACT 



SOURCE 


88 


df 


M3 


F 


TOTAL 

BtROR 


10658.597 

599*. 572 


iko 

93 


6k.k38 




CLASSES 


W 6 k.e 3 


k7 


99.235 


l*5k0 




Table 51 

AmiXHB OP OOTAKLAJKB, GATES DOBD PBCCTOIAgCP 


P « .05 


SOURCE 


88 


df 


M3 


F 


TOTAL 

BSRGR 


k 006.269 
2172.862 


128 

81 


26.826 




CLASSES 


1B55.*03 


k7 


59.009 


l.k5k 



9. S. 



Tht nneorrected seens and standard deviations of the individual read- 
ing tests are shown in Table 32* The naans are consistently soawvhai high- 



Table 32 

tnKMGR2CTB> MEAB8 AS) 8TA10AHD DXVXATXGKB FOR THE OTIfUXXAL 
READZHG TESTS, FOR FOUR WACHXHG METHODS 



TKT 



M E 



H 



B.R. 

M. S.D. 



fa. 

N* S.D. 



0 D 

T37“ 



M. S.D. 



TJK4L.T. 

M** S.B. 



Gilmore Oral Reading 
Accuracy 
Rate 

Fry Test of Phonetic Wds. 2.19 5 . 0 k 
Gates Word Pronunciation 7.9k 3.9k 



1.83 1.06 1.82 .85 1.50 .60 1.5k .8k 

ko.kk 25.2 38.95 23.20 30.19 25.78 29.76 25.60 
3 . 5 k 6.98 .7k 1.72 1.92 k.20 

8.k8 6.19 5.81 k.76 5.69 k.91 

Ktolsen Phonemic Word 5*k2 6.76 6.23 8.k2 2.60 3.5k 3.23 5.53 



k 8 



k 8 



k 8 



k8 



H 
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ZJl*^**^ " Bthoa * (B - R - “* ”*•> *•“ *» «. 

I!!?* ° ritlC * 1 rati °* fOT ' U "* r * n °“ — « the uncorrected 

® 8 * a * w* shewn in TSble 33 . . . 

xm,xm ??. xnt differences between the two 

TtTZ (B,R - “* a0 

2^Z.TT c ” b * twwn *• *" Mrthod. ^ noo . 

*"*-*• (P < . 05 ) but not certain. of 

T^ZT^TZ T *° mh ” hm ******” «-» .os 

less then *01 of being chance results* 

BOmrer ’ tte MW to lable 32 w not COIWtod 
***** Ability as shown on the pretests. As noted tbcve^there^vali 

irmm? r *• «mrzi 

T* «* th. ,<a lev* before correction bec»e non-significant 

•«» correction, if the covariance correction h.h ZlT “ 

-tv , - , «™nce correction had been applied to the Fry 

«d tsnsm scores, the rernt. night have shorn the sen, effect. It J£. 
TL^ be C8rt aia «>.* th. signified differ®,., in the »*».«, th, 
VOti Pr ° ,Wn0i ‘ tiflO teit * « •» t* differences in teaching nrthod.. 

r-r:r b * *■ •*“ « ««»«« m 

nrthoL. *" ^ < *“ Ce ' nevWrth8l, “ ^vorod the SkiU,.c®tered 

ford . tZZTl ° f Vtlri “ Ce ’ U * 1 “ 8 tl “ C “®“ t8r «• for the Stsn- 

~ Z r m SC( *“ 6bt * inaa ***“ the ^vidualiy tested JT 

and Gates)*®! ^ ^ * e “ U ” S f0r C0TOri “'« COUaore Accuracy 

n^trr i— uttB— .to- 

tween ^ Sa, “ *»”*”«* •*•»«*** differ®.,, be- 

vaii®ce Tl° f *" *“ ‘ PProach8 *-- «•*»• disappeared in the analysis of 
vari®ce. In the «>alysi 0 of variance table, for ih s individuals 11 

lll^rr betWM “ aWr0aCheS ° r b9tWe “ « tbod » that reaches 

Hi ! IT 16 *""* K — that the snau hut rtati.tic.lly 

ta“lT n0ted #bWa n0t “ crtb »t,le to differences be- 

differeH* “ " ethods ‘ Heltb « «• «M, ascribrtle to school 

differences or treatment interactions. It Am - 

duca all of these analv*i* n-r w 06,1 nocea * ary to re Pro- 

st> action «>, ^ ^ f Variaac ® tables; they are available for in- 

JJH* any °” # b8 «>»* coaparlson. are bwd « 

of W pupils for each aethod. Th, result, for those .«^e, do not 
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significant raUtlonwhipw batwrau teaching methods and individual test 
suits, when til classes are included* 



re- 



The Writing Samples 



The children in til of the CRAFT classes had written two composition*, 
a "restricted stimlus" composition and a "unique stimulus'* cc^ositioa. 

The "restricted stiMiln** was the same for all cooperating projects and con- 
sisted simply of asking the children to write their own stories. The other 
stimulus was "unique* for each erne of the 2? projects. The CRAFT teachers 
were asked to show their classes three picture* all illustrating suner- 
tisa activities. Bach teacher was to motivate her class in her customary 
fashion for creative writing. During the discussion, the idea of writing 
about stoner tm was elicited. 

The papers of the 192 children who were given the individual reading 
tests were scored. Because of pupil absence a few papers were missing, but 
the H*s for all methods were above 40. 

The three scoring procedures required of *21 cooperating projects in- 
cluded a araaur. of acchanicc (punctuation, paragraphing, etc.), nuAer of 
words spelled correctly, sad total motor of running vonU. According to 
thaso criteria, it was possible for a child who aanagad to write a long, 
unconnected series of correctly- spelled words to receive a hl^ier score - 
than a child who wrote coherently hut with may misspellings tad poor pune- 
tuation. The CRAW research staff attempted to eliminate this source of 
error by constructing a three-point "lucidity" scale which measured the 
sense of coherence of both the "restricted* and the "unique" writing sta- 
ples. Three Independent scorers rated each of the 38b compositions for 
lucidity. 

The means for the four teaching methods on the five Writing Sample 
score* are shown in Table 3*. These are the unadjusted means. Of 30 com- 
parisons, only one difference reached the .05 lead of significance. The 
differences among methods are smell and lacking in significance because of 
large standard deviations and relatively small H*s (Vl to kk). 

The two lucidity acorea war# amenable to analyses of covariance, 
with result* shown in Tables 35 and 36 . In both tables the difference* be- 
tween methods rwaining after the covariance adjustment of msans are too 



«.v^ * »» tv*-** -t 



Table 3 * 

UWCORRECTED MEANS FOR THE WRITERS SAMPLE SCORES 
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MEASURE 


Sk£tLs>Ceetered 


Language- Experience 


3*Re 


m. 


L.E. 


L.E.-A.V. 


Mechanics 


55.98 


50.66 


55.07 


55.02 


No, Words Spelled Correctly 


15.75 


14.10 


14.66 


15.09 


No, of Running Words 


39.59 


17.64 


17.77 


18.89 


Restricted: Lucidity 


2.59 


2.23 


2.40 


2.32 


Unique: Lucidity 


2.fe5 


2.53 


2.19 


2.27 


N*s range free 4 i to 1*4 



Table 33 

ANALYSIS OF COVARIANCE, RESTRICTS) WRITING! SAMPLER LU C I D IT Y 



SOURCE 


^ ss 

t 


df 


MS 


F 


TOTAL 


89.7264 


128 






ERROR 


57.5183 


81 


0.7101 




CLASSES 


32.2100 


47 


0.6853 


0.965 










N.S. 




Table 36 








ANALYSIS OF COVARIANCE, UNIQUE WRITING! SAMPLE, 


LUCIDITY 




SOURCE 


SS 


df 


M3 


F 


TOTAL 


88 . 71*70 


120 






ERROR 


50 . 91 H 9 


73 


0.6975 




CLASSES 


57.8321 


47 


0.801*9 


1.154 



N.S. 



■Mil to b< significant. It teens safe to conclude that stellar results 
weald have been found for the other three Writing Sample scores, and that 
the Writing Samples failed to reveal significant differences. 



Corrections for Differences la Length of School Day 



In Chapter ill the feet v&s Mentioned thet in three of the nine schools 
the first grades had to be placed oo split-session days of four hours because 
of overcrowding, while the other nine schools were on full-session five-hour 
days* Three of the four Methods included same split- session classes; the 
fourth (L.E.) did not. The teachers on full-session were instructed to de- 
vote three hours a day to the Language Arts; the split-session teachers were 
instructed to spend two and a half hours on L ang u ag e Arts* 

Obviously the effect of this unintended difference in school day had 
to be investigated to see if it influenced achievement. Within the two main 
approaches separate means were computed for the full- session classes the 
split-session classes. The results, given in Table 57, show quite clearly 
that the difference between full- day and split-session was important. The 
reduction in time in split-session classes seems to have had a more detri- 
mental effect on the Audio-Visual classes than on the Skills-Centored 
classes* 

It must be noted that the difference between split-session and fall- 
session classes involved more than a difference of one hour per dey in class 
time* The full-session classes had rooms to themselves, which the teachers 
ccul* decorate an they pleased* They could leave items on a blackboard or 
bulletin board from one day to the next* After a chree-hour morning there 
was an hour for lunch and a two-hour afternoon session. The split-session 
classes occupied their rooms from 8:00 A.M. till noon. Another class used 
the same room from noon till 4:00 P.M. The need to leave the mom in shape 
for the next class may well have had significant influences on teachers* 
procedures* The four-hour period with only a short snack period seems long 
for little children. Thus the split-session classes were probably at a 
disadvantage in ways other thaniinply having less instructional time. 

The poattest results were therefore recomputed, dropping oat all split- 
session classes and using the adjusted means for the full-session classes* 

The results are shown In Tables 58, 59, and 40. The results for the two 
main approaches are shown in Table 58. There are consistent differences 
in favor of the Skilla-Centered Approach on all the reading tests a» d spell- 
ing* The only test on which there is no difference is Vocabulary, which is 
a measure of hearing vocabulary and not a measure of reading. 




Table 37 

SIGHUTCAHCE CP D37PERSVCES BETWEEN FULL-SESSION AND SH2T-SB3SI0H 
CLASSES, ADJUSTED STANFORD RAW SCORE NEARS 



MEASURES BY 
METHOD 


Pull-Session 
R Mean 


Split-Session 
If Mean 


Diff. 


t 


P 


Word Reading 
L.E.-A.V, 


142 


14.65 


.127 


H.15 


3.50 


*.a. 


< .01 


Ph. 


184 


15.63 


93 


15.12 


•51 


.66 


R.S. 


B.R. 


233 


14.90 


52 


4.16 


.74 


.88 


N.S. 


Paragraph Meaning 


L'Et'At/* 


134 


10.60 


102 


8.01 


2.59 


3.45 


< .01 


Ph* 


178 


10.79 


78 


12.86 


-2.07 


- 2.66 


< .01 


B.R. 


226 


13.72 


49 


11.44 


2.28 


2.53 


< .01 


Vocabulary 


L.K.-A.V. 


118 


16.49 


96 


12.50 


3.99 


7.22 


< .01 


Ph. 


156 


14.64 


67 


15.53 


- .89 


-1.55 


R.S. 


B.R. 


219 


15 .4l 


48 


18.47 


- 3.06 


-4.31 


< .01 


Spelling 


L*E.«A.V. 


118 


9*26 


96 


4.94 


4.32 


7.26 


< .01 


Ph. 


1$6 


8.?4 


67 


6.94 


1.80 


2o84 


< .01 


B.R. 


219 


8.98 


48 


5.78 


3.18 


4.67 


< .01 


Word Study SMlls 


L.E.-A.V. 


142 


26.93 


130 


22.C8 


6.85 


7.38 


< .01 


Ph. 


181 


26.77 


93 


27.40 


1.37 


1 . 1»0 


N.S. 


B.R. 


231 


26.53 


52 


21.77 


6.76 


5.78 


< .01 



The two Shills-Ceniercd Methods are compared In Table 39* The one 
significant difference is on Paragraph Meaning, on which the Basal Reader 
Method is significantly higher. On the other tests the differences fall 
within thfc range of chance fluctuations* 
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Table 38 

SIOTnCAKJE <* KCmEW® BSWOT Ho Aramm, abottto 
B«r SCOBS M2AHI TOR TOLL SESSION CLASSES 



TEST 



Stanford 1 
Void Reading 
Paragraph Meaning 

Vocabulary 

Spelling 

Word Study gv*vi« 
Gilmore Accuracy 2 '^ 




15.22 

12.43 

15.09 

8.87 

28.63 

1.92 



gatea Word Pronunciation 2 9.31 

1 ». 

»•« range fro* 360 to 426 

2 hi 

«*a range frost 59 to 72 

3 

Grade equivalents 



15.50 

10.49 

15.09 

7*92 

26.57 

1.77 

7.71 



1.72 


4.72 


< .01 


1.94 


4.82 


< .01 


0 


0 


H.S. 


.95 


2.97 


< .01 


2.06 


3.88 


< .01 


.15 


0.11 


H.S. 


1.60 


1.69 


H.S. 



SE3CTIC/JCB OF DIFmHJKBS BHWEffl BASAL RMDKR AKD 
. PHOCTISIM1. ffiTHODS TOR fOLt-SBSSIOR CUSSES 



TEST 



Stanford' 

Word Reading 
Paragraph Meaning 
Vocabulary 
Spelling 

Word Study Skills 
Gilmore Oral-Accuracy 




14.90 
15.70 
15.41 
8.96 

28.53 

2.00 

Gatea Word Pronunciation^ 8.80 

1 H*a range fro* 156-233 
^ H e s range fro* 3l-4o 



15.83 

10.79 

14.64 

8.74 
26.77 
1.82 

9.75 



- .75 


-1.426 


H.S. 


2.95 


5.110 


< .01 


.77 


1.615 


H.S. 


.22 


.598 


H.S. 


■ .24 


- .317 


H.S. 


.18 


.099 


H.S. 


• .95 


- .742 


H.S. 



Tbt two Ianguage-Experience Methods ere coegared in Table 40. The 
differences ere consistently In flew of the Audio-Visual Method* Poor 
of the fire Stanford scoree show significant differences, and the consis- 
tency with which all seven comparisons are favorable to the Audio-Visual 
Method is ispressive. It teens safe to conclude that there is a difference 



Table 40 

SKHCCPIGAMCE CP DOTEBEBCES BETW5E5 lAEGfttAOg-EXPE BIE E UE AMD 
AUDIO-VISUAL METHODS FOB FUtt-SESSICM CLASSES 



L-E.-A.V. 

TEST 

Maan 


L.E. 

Mean 




t 


P 


Stanford 1 












Word Beading 


14.65 


12.93 


1.72 


3.162 


< .01 


Paragraph Meaning 


10.60 


10.43 


.17 


2.814 


N.S. 


Vocabulary 


16.49 


14.31 


1.96 


3.974 


< .01 


Spelling 


9 .26 


7.2? 


1.99 


4.092 


< .01 


Word Study Ski21» 


26.93 


25.38 


3.5$ 


4.506 


< .01 


OilMore Oral-Accuracy 


1.95 


1.67 


.26 


.179 


H<G. 


Gates Word Prcrsmciatlon 2 


8.38 


8.01 


.37 


.257 


M.S. 



1 M's range frcsi UB-204 

2 M*s range from 19-48 



between the two L an g u age-Experience Methods, ani that the Audio-Visual 
Method produced better results than the regular Language-Experience Method. 

The above comparisons are based on raw scores. To get a clearer idea 
of the Magnitude of the differences, it is necessary to translate tha raw 
score neene into grade equivalents. When this is done, the results are as 
shown in Table 4l, in which the grade equivalents have been rounded to the 
nearest tenth of a year. It is apparent that several of the raw ccore dif- 
ferences that were statistically significant either disappear or become 
«1ni» a l when translated into grade equivalents. 

Within the SkUla-Centered Method approach, the Basel leader Method 
is alight ly higher than the Phonovisual Method in Meaningful silent reading. 



In accuracy of oral reading, and on the Gates Word Pronunciation. Of 
theaa, only tha superiority in Paragraph Meaning is significant. The 
Hwooriaual Method ia higher only on the Stanford Word Beading teat, and 
that difference ia not aignificant* The lack of any superiority for the 
Phonovisnal Method, together with ita lower Beane in Paragraph Meaning and 

9&SSS* Accuracy, would seen to indicate that the Basal Reader Method has 
a slight advantage* 



Table *1 

ADJUST® GRADE SCORE MEANS FOR FULL-SESSION CLASS® 



TEST 


s © 


— Ce Approach 


L.E. Approach 


B.R. 


Ph. 


Total 


L.E. 


L.E—A.V. 


Total 


Stanford 














Word Reading 


1.5 


1.6 


1.5 


1.4 


1.5 


1.5 


Paragraph Meaning 


1.6 


1.5 


1.5 


1.5 


1.5 


1.5 


Vocabulary 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


Spelling 


1.7 


1.7 


1.7 


1.6 


1.7 


1.6 


Word Study Skills 


1.5 


1.5 


1.5 


1.4 


1>5 


1.4 


GilMore Oral-Accuracy 


2.0 


1.8 


1.9 


1.7 


2.0 


1.8 


Gates Word Pronunciation 


2.4 


2.3 


2.3 


2.3 


2.3 


2.3 



At this point another look at the Fry and Karlaen word lists is in 
order. These two tests were constructed especially for use in the ZJ co- 
operating projects, as Measures of ability to read unfndliar but phoneti- 
cally regular words. The Means on these tests (see Table 32) show no sig- 
nificant differences between the Basal Reader and Fhonovisoal Methods. If 
the Phonovisual Method had been particularly successful in teaching woxd 
attack skills, it should have shown significant superiority on these two 
word lists, and on the Stanford Word Study Skills. Such is not the case. 

On both word lists P is Mich greater than .05, showing a lack of signifi- 
cance. 

Within the Language-Experience Approach the Audio-Visual Method is 
•liglitly higher on Word Reading, Spelling, Word Study Skills, and G-n-™— 
Accuracy; the two L.E. Methods are equal on the other three Measures. The 
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•uperiority of the Audio-Viiual Method over the regular Leagutge-Sxp«ri- 
ence Method remains visible in the grade scores. 

The Audio-Visual Method also shows up as equal to the Skills-Cen- 
tered Approach on six of the seven tests, and slightly higher on the Gil- 
More. The regular Language-Experience Method is the lowest of the four 
Methods on Word Reading, Spelling, Word Study Skills, and Gilaoro Accura- 
cy. It is obvious, then, that three of the four Methods— B.R., ph., and 
L.E.-A.V— cane out nearly equal in results, and the fourth, the regular 
L.B. Method, achieved slightly poorer results and is the reason for the 

slight advantage of the Skilli-C entered Approach over the Language-Exper- 
ience Approach. 

Evaluation of Resu lts for the Total CRAFT Popn^tion 

The expected average first-grade performance at the end of May is 
expressed as a grade equivalent of 1.9. The CRAFT instructional period 
had started on October 19, 196^, so that there had been a little less 
than eight Months of reading instruction. The reading readiness program 
of the preceding Month should, however, be included. * grade equivalent 
of 1.9 seems, then, a reasonable basis for evaluation. 

On the two individual tests for which grade norms are available, the 
CRAFT Mean grade equivalent for all full-session classes is I.85 on the 

Accuracy, and 2.3 on the Oates Word Pronunciation. The Qjbgre is 
known to have based its norms on those for the Metronolitan Achjgy^gt 
Test, which is the one usually employed in cityvide surveys in Ifsnr York 
City. The derivation of the Gates norms has not been specified. It seems 
safe to conclude, however, that on these two measures the CRAFT pupils did 
not fall appreciably below the norm. 

The St * nford Prt»»ry 1 Battenr. Tam X, .Rear, to have non. which 
are store severe than then of the Metropolitan, or thoaa of previous edi- 
tions of the Stanford, and are estimated to give grade scores three or four 
■oaths lower. CRAFT wean grade scores for all full-session classes are 1.5 
on the three reeding scores and Vocabulary, and 1.7 on Spelling. Consider- 
ing that on seven readiness ■assures the aedlan percentile of the CRAFT pu- 
pils was 23, and considering the probable discrepancy between current Stan- 
ford none end none of other teste, the CRAFT result* nay he regarded as 
satisfactory. 



Bit 8ra Diego Inventory of Attitude 
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One of the posttest measures prescribed for the cooperating first- 
grade reeding studies was aa attitude scale developed in San Diego for 
■assuring the degree of interest in reeding and positive attitude toward 
reading. It was given as a group test daring the posttest period. The 
exanlner read each statement, then the perils narked the •yes" or the "no” 

on their answer sheets. The score is the number of answers indicating 
favorable attitude. 

The results for the four teaching methods are shown in Table k£, 

She Basal Reader method had the highest mean, and is significantly higher 
(P < .01) than each of the other three methods. The Phonovisual method is 
lowest. The difference between the two Lsngnage-Esqperienee methods is not 
significant. The difference between L.E. and Ph. is probably significant 
(P < .05) but the difference between L.E.-A.T. and Ph. is not significant. 



Table k2 

RESULTS OP BAR DUBO XKVERTOKT Of PUPIL ATTITUDE 



METHOD 



Mean 



S. D. 



Basal Reader 
Phonovisual 
Language Experience 
L.E. Audio-Visual 



277 


17.20 


4.27 


276 


14.96 


5.14 


27b 


15.87 


5.33 


259 


15.58 


5.& 



ShM. results round cat the picture of cut come*. The Bead Header 
■athod (with thl« pqjnlation) waa not only slightly euperior in developing 
silent reading comprehension, hut also achieved significantly highest scores 
to reading attitude. The two tanguege-B*erience nethod* were about equal 
to pupil attitude, although the L.B.-A.T. Method surpassed the L.E. ssethod 
to reeding and spelling skills. The Phonovisual aethed, which alaoat 

equaled the Basal Header aethod to results, aade the poorest showing to pu- 
pil attitude. 



f 

i 





I 



' * z 










/ 




Consideration of Possible Interfering Variables 



Attention will now be given to a rafter of factor* which could have 
a bearing on the interpretation of the remit*, in addition to the full- 
session— split-session problem which ha* been analysed above. 

Effect of Preschool Experience 

A special study of the Impact of preschool experience was made using 
the CRAFT children in two schools (eight classes, 147 children). The chil- 
dren who had had kindergarten experience were higher than the non-kinder- 
garten children on five of the six pretests, but none of the differences 
were significant at the .01 level (see Table 43). 



Table 43 

PRETEST RESILTS FOR SAMPLES OF KINDERGARTEN 
AHD RON-KINDEBQARTBf CHILDREN 





Kinder- 


Nan-Kgn. 




Reading Readiness Measures 


garten 




Diff. t P 




Mean 


Mean 




Metropolitan Word Meaning 


5.10 


5.45 


- .35 .967 N.S. 


Metropolitan: Listening 


7.04 


6.62 


•42 .995 N.S. 


Mttxptar-Durrell Phonemes 


10.90 


8.45 


2.45 2.026 < .05 


Muxphy-Durrell Letter Names 


24.06 


22.25 


l.ftL .761 N.S. 


Bfaxphy-Durrell Learning Rate 


8.83 


7.53 


1.30 I .992 < .05 


Thurstone Identical Forms 


7.57 


5.97 


1.40 1.19k N.S. 




w _ m 
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To the extent that kindergarten and other preschool experience helps 
a child to i^rove in readiness for first grade work, ii should influence 
his ability to perform cc readiness tests as well as to learn to read. The 
effects of preschool experience do not seem to have made very greet differ- 
ences on the pretests. The differences that did exist were taken care of 
by the covariance adjustments, which removed the influence of differences 
in readiness from the final test results. 



Of course, elaborate precaution had bean taken In the initial ta- 
aiconant of pupils to balance the assignat of kindergarten and non- 
kindergarten children equally to the teo teaching nethoda in each 
a. assignment procedure. end the corarUnc. ,djust«nts, taken togrther, 

rule cnt the possibility of preschool experience having favored one teach- 
log aetbod over another. 

Sex of Pupils 



The dlatributicn of boy. and girla to the f our inatructienal nethoda 
in the i CBm Project ms approximately even. She peroentagea are .bom in 

kk. With each aaall difference., an effect of sex differanesa ca 
outcomes is unlikely. 

In addition, the sample studied for the effect of preachoel experi- 
ence m alao atudied to aee if there were any aignificant aex difference! 



xaoxe 

PERCERIAGBS CP GIBLS AND BOYS It® SHE POOR METHODS 



METHOD 



Girls 



Basal Reader 
Fhonovisual 
Language-Experience 
Language-Experience Audio-Visual 
TOTAL 



Boys 



Total 



90.9$ 


*9.1* 


100* 


51.9* 


W.l* 


100* 


w.t* 


51.fi* 


100* 


51.** 


*8.fi* 


100* 


90,6$ 


*9.** 


100* 



on the preteats. She results are chans in Tibia b5. Three pretest favored 
the girla, three favored the boys, and difference was aignificant. 

Kually, the covariance adjustments took care of any alight effects 
of sex differences that night have influenced readiness tat learning. 





Table 45 

SBC DIFFERENCES (V THE PRETESTS 
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READINESS MEASURE 


Girls 

Mean 


Boys 

Mean 


t 


P 


Murphy-Durrell 


Phonemes 


10.25 


9.04 


*990 


N.S. 


Total Letter Names 


23.90 


22.37 


.643 


N.S* 


Learning Rate 


8*01 


8*29 


- .422 


N.S. ‘ 


Metropolitan 


Word Meaning 


4*96 


5-59 


-1.750 


N.S. 


Listening 


6*69 


6*95 


- .622 


K.S. 


Thurstone Identical Forms 


6*94 


6*36 


•491 


N.S. 



Intercorrelations of Many Fact ora vlth Poetteits 

In order to locate additional factors that sight cat across the ef- 
fects of the instructional methods, an intercorrelation matrix van com- 
puted far 5 4 variables* The results are shown in Table 46. In addition 
to the pretests and posttests, the variables include 13 scores based on 
OScAR-R, six scores based on the teachers 9 Logs, and a variety of other 
items on vhich information had been collected* The scores used are the 
48 class means* For the seven posttests that were adjusted by covariance 
the adjusted class means vere employed* To save space, decimal points 
have been omitted* 

Table 46 mas inspected for significant correlations. An r of .37 
(P * *01) vas taken as the minimum to be considered significant* 

The four protests used in the covariance analyses generally had non- 
significant correlations with the posttests, shoving that the covariance 
adjustments had been effective* The remaining pretests, vhich could not 
be used for covariance became of missing classes, generally shoved signi- 
ficant correlations vith the posttests* 
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Teacher Logs 

A detailed report on the Teacher Log data has already been presented 
at a professional meeting and is to be found in the Appendix. The in- 
structions to teachers on how to allocate their Language Arts instruction- 
al time are also presented in the Appendix. Here only some of the high- 
lights will be noted. 

At the beginning of this study the teachers were accustomed to 
spend considerably’ less instructional time on reading and related acti- 
vities than the CRAFT plans required, and it took several months before 
most of them approximated the three hours a day expected. On total time 
the two approaches were nearly equal (Skills-Centered, 170 minutes 5 
Language - Ejcpcr i enc e , 175 minutes), and the small difference is due to 
the absence of split-session classes in the L.E. method. 

There was a quite large difference between the two Approaches in 
the proportion of time devoted to Reading and to Supportive Activities. 

The Skills-Centered Teachers spent 55 percent of their time on Reading; 
the Language-Experience teachers spent only 59 percent of their time 
on Reading, and 6l percent on Supportive Activities. 

The inter correlations in Table 46, which were not available when 
the Teacher Log report was written, show a very highly significant 
fact about teachers* use of time in relation to posttest results. Neither 
total Language Arcs instructional time nor Supportive Activities time had 
significant correlations with the posttests. But the total Reading time 
had correlations ohat were both significant and substantial, with the 
Stanford Word Reading, Paragraph Meaning, and Spelling; Gilmore Accuracy 
and Rate; and Fry and Gates word lists. These correlations ranged between 
.40 and . 61 . 

It would be tempting to conjecture that what really counts in teach- 
ing beginning reading to disadvantaged children is how much time one 
spends in the direct teaching of reading skills, and that the method of 
instruction is of comparatively little importance. This would be a gross 
oversimplification, as can be seen by considering the data in Table 47. 

Table 47 shows the average number of minutes per day for the four 
methods. The Audio-Visual teachers spent the least time in Reading 
activities — 6 l percent as much as the Skills-Centered teachers, and 70 
percent as much as the other Language-Experience teachers. Yet their 
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results equaled those of the Ski Llb -C entered teachers and surpassed those 
of the L. E. teachers* 



TABLE k7 

MAN INSTRUCTIONAL TIME PER BAY IN 
FOUR TEACHING METHODS 



Minutes per Day 


B.R. 


Fh. 


L.E* 


L.E< -A.V . 


Mean S«D« 


Mean S.D. 


Mean S.D. 


Mean S.D. 


Total 

Reading 

Supportive Activities 


169.1 23.52 

94.9 18.64 
74.4 16.1 


170.8 28.64 
94.8 11.86 
76.1 31.12 


197 . 25.12 

83.2 13.42 
113.8 20.58 


157.8 20.11 
57.7 12.78 
100.1 18.02 



The specific time used by L.E. -A.V# teachers for audio-visual activities 
was classified in the Log under Supportive Activities and averaged 24 
minutes per day* If we add this to their Reading time of 57*7 minutes the 
result is 81.7 minutes, still slightly under the t.E. mean and well under 
both Skills-Centered means. 

It has already beer shown that the L.E.-A.V. Method equaled the two 
oki lls-Centered Methods in overall reading results and surpassed the regu- 
lar L.E. Method. The total time per day was lowest for the A.V. teachers. 

Had they spent more time on reading skills, their results might have been 
still better. 

Chronological Age 

Mean ages were calculated for the four teaching methods . They ranged 
from 79*5 months to 79.6 months, a range of one-tenth of a month that 
could not possibly have a bearing on the outcomes of the methods. 

Pupil Attendance 

The mean number of days absent per pupil ranged from l4.l8 for Phono- 
visual to 16.42 for Language Experience. None of the differences in attend- 
ance between pairs of methods was significant at the .01 level, so it is 









very unlikely that pupil attendance differentially influenced the post- 
test results. 

Class Size 



The mean number of CRAFT children per class, on frfey 1, 19 65, rang ed 
from 29*75 in L.E. to 28.15 for L.E.-A.V. , vith Phono vi sual at 28.42 and 
Basal Reader at 28.80. * 

The mean class register on May 1, 1965, for all CRAFT classes was 
approximately 55 pupils. Of these, 28 or 29 had taken the pretests and 
were included in CRAFT statistics. Uie others had entered some time 
during the instructional period and had not taken the pretests; they were 
therefore excluded from the statistical treatment. Whether there were 28 
CRAFT children or 29 should have had no hearing on the results. The 
principals had been instructed to keep the total class registers evenly 
balanced by replacing children who left the CRAFT classes, and did so. 

The high registers are typical of class size in the New York City schools, 
and therefore CRAFT findings should be applicable to the city schools with 
similar populations. 

Teacher Attendance 

The data on teacher absences are shown in Table 48. Although the L.E. 
teachers had twice as much absence as any other group, the difference does 
not reach the .05 level of significance (because of _.s very large standard 
error). The absence rates in the other three groups are very «ni^h alike. 

The large mean and S.D. for the L.E. teachers are due to two teacher replace- 
ments. One of the LeE* teachers was promoted out of the classroom at mid- 
year. Another teacher took a leave because of poor health. These changes 
probably offset each other in terns of the quality of instruction. 



ZABLE 48 

MEAHS AHD STAJIDARD DEVIATION FOR 8X0010) 
TEACHER VARIABLES 



Variable 


B.R. 


Ph. 


L.E. 


L.E.-A.V. 


Mean S.D. 


Kean S.D. , 


Mean S.D. 


Keen 


Teacher Absence 
Years of Teaching Exper. 
First-Grade Tchg. Exper, 


7.96 4.58 
3.83 5.10 
2.17 1.27 


6.34 4.21 
8.33 9.63 
3.42 3.55 


16.37 23.47 
9.25 9.25 
3.83 3.59 


8.50 3.52 
10.25 13.16 
5.92 8.89 



ic 



12 



12 



12 



Total T eaching Experience 



The teachers varied widely in age and teaching experience; the latter 
seemed more premising for analysis. The second line in Table 48 shows 
that the fl.E. teachers had a mean of 5.83 years of teaching experience, 
while the other three groups had means between 8.33 and 10.25. The differ- 
ence between the B.R. teachers and the l.B. teachers is significant 
(P <-05); the other differences fail to reach the .05 level. 

If experienced teachers are more likely to get. good results than inex- 
perienced teachers, the B.R. method was slightly handicapped. If, on the 
other hand, youth and inexperience made for flexibility and amenability 
to instruction and supervision, the strong in-service training program of 

the CRAFT Project could have turned the inexperience of the B.R. teachers 
into an asset. 

It is probable, also, that the firm structure and detailed directions 
in the manuals used by the Skills-Centered teachers made up to some extent 
for lack of teaching experience. Inexperience may have nattered less in 
this method than in the Language-Experience Approach. 

First-Grade Teaching Experience 



The four groups of teachers are compared in terms of amount of teach- 
ing experience in the first grade, on the third line of Table 48. While 
the B.R. group had the lowest mean end the L.E.-A.V. group had the highest 
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uean, none of the critical ratio# reached the .05 level of significance. 

A# with total teaching experience, there is no clear evidence that the 
differences between the methods in this teacher characteristic should ^ 
have had any specific effect on the outcomes of the study. 

Willingness to Repeat the Study 

After the posttest period was over> and before the teachers were 
given any information about the outcomes, all of the first-grade teachers 
were invited to participate in a first-grade replication study, in which 

each teacher would use the same method she had learned with a new class 
of first-grade children. 

Of the 48 teachers, 52 volunteered for the replication study. Of 
the other eighteen, thirteen had reasons unrelated to the methods, such 
as a maternity leave or husband moving out of the city. The other teachers 
leaving the study, because of dissatisfaction with the method, were divided 
among the teaching methods as follows; B.R., 2; Fh., 0; L.E., 2; and 

L.E.-A.V., 1. There does not appear to be a significant difference 
attributable to adverse reaction to the project. 



Effec ts Attributable to Consultants 

So far as the CRAFT research staff has been able to discover, there 
were no evidences of differences in the quality of instruction and help 
provided by the four reading consultants. All four were mature women with 
years of classroom teaching experience, and with substantial previous 
experience as reading consultants. They submerged any personal preferences 
for a particular way of teaching reading and responded in a highly profes- 
sional way to the challenge of trying to help teachers in all four methods 
to which they were assigned. 

nils subjective impression Is reinforced by the practically complete 
absence, in the analysis of variance tables, of any significant interactions 
by schools, or by method interactions within schools. If a particular 
method had been given an advantage by the consultant in a particular dis- 
trict, this should have shown up as a school interaction. The absence of 
such interaction supports the conclusion that there are no differential 
effects attributable to differences in consultant supervision. 




tti« sectloo of Chapter V has looked at a number of factors, other 
than the teaching methods, which seemed to have potentiality for affecting 
the result, and obscuring the relationship, between teaching method. end 
results. She following have been considered: ( 1 ) effect of preschool ex- 
perience} ( 2 ) sex difference. In readiness; (5) aspect, of teaching style 
as classified and scored with the 08 cAR-R; (k) log data. Including total 
language Arts Instructional tine, Reading Time, and Supportive Activities 
time; (5) chronological age of pupil.} (6) pupil attendance; (7) class 
size; (8) teacher attendance; (9) total teaching experience; (10) first- 
grade teaching experience; (11) willingness to repeat the study; and (12) 
effects attributable to consultants. Of all of these variables, only 
total Reading time was significant. Highly significant differences in 
teacher effectiveness were found within each method, but efforts to 
measure components of effectiveness were not successful. 



ISM .Characteristics of Book. Determine Pupils' Reactions ew 

The following analysis is based on replies to a questionnaire circulated 

among teachers, and on observation of the children by the consultants and 
research staff. 

The general conclusion drawn was that the choice of favorite books by 
the CRAFT disadvantaged children is similar to that of middle-class children. 
As with middle-class children, plot element is extremely important. The 
tried and true stories heavy with plot that children have always liked are 
spellbinders, regardless of socio-economic status: stories such as The 
SSSSU^Sb ggter_aabbit, gingerbread Boy, and Little Red Hen . goo^T 
written comparatively recently which have become classics in a relatively 
short time also seem to intrigue CRAFT children, for example. Make Way for 
Duckies by McCloskey, Caps for Sale by Slobofkin, the Angus books, parti- 
cularly A n gus and the Ducks , by Flack, Millions of Cats by Wanda Gag, Little 
Toot by Gramatky, Curious George by Rey, the Pretzel Books, the Holsv Books. 
Tresselt's Johnny Make Believe. Duvoisin's White ggow. gnow, 

Petersham's Box .With Red Wheels, Slobodan's Friendly Animals. Tresselt's 
Rain Drop Splash . All of these and many others were well-liked by the 



CRAFT children. 



/ 



- 96 - 

Several sources of such stories are: Stories That Never Grew Old 
(Platt and Munk), Stories of Animals (Whitman and Co.), Folk Tales 
Children Love (Platt and Munk), and Tall Book of Furs cry Tales (Harper & 
Row). 

Are books more likely to be favored if they are integrated? It is 
most desirable to have multi-ethnic illustrations. Even a plotless 
preprimer was observed being hugged and loved and called ”the best story,” 
regardless of the dearth of story; the only explanation possible is the 
tendency of Negro children to identify themselves with Negro children in 
pictures. Integrated illustrations, however, are not enough. The story 
must be a good one; the plot element must be strong. Among the integrated 
books several were quite successful with CRAFT first-graders: Keats* s 
Whistle for Willie. Snowy Day. My Dog is Lost. Terry’s My Dog Rinty, and 
Wi lliamson'a The No-Bark Dog . As a basis for good discussion of urban 
social studies problems. Bank Street's Around the City and Uptown. Pown- 
town served well, as did Chandler's Let's See the AniLals. the primer in 
the new Chandler Language Experience Series. The children did not, how- 
ever, favor didactic integration in their stories. For example, one book 
which centered attention on the introduction of a Negro boy to a white boy 
was unpopular, apparently because there was no dynamic plot element, and 
it seemed pointless to first-grade children. 

A® important as plot element and integrated characters is the manner 
of presentation. The CRAFT staff, both Negro and white, feel very strongly 
that the differences in taste between iiiddie-class and Negro children has 
been emphasized far beyond reality. Even the stories of kings and queens 
and princes ^nd princesses, if they are good ones— such as the Cinderella 
story, in which „he disadvantaged child can have some identification with 
the poor disadvantaged Cinderella— are quite successful when the presenta- 
tion is good. 

Elements of presentation which seem effective are that: (l) there be 
a personal rapport with the teachers; (2) the group be small and clustered 
near the teacher; (3) her gestures be broad; (4) her voice be dramatic in 
intonation and appropriate to the dramatic impact of the story; and (5) 
pictures be shown along with the telling of the story. It appears important 
that the story be narrated by a teacher who is sensitive, and can make 
quick changes in la n guage appropriate to the comprehension level of her 
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youog liittntn* Another observed source of effectiveness li teacher 
avoidance of didacticiaa in the course of the first reading of the story. 
She Should tell the story right through, if necessary in her cun words 
and showing the pictures. It appears that if the story is told without 
interruption, the child is nore likely to sustain attention to the end. 
After the initial relating of the story, the child's enjoynant of it 
will sustain him through rereading in the original language, end question' 
ing to check comprehension and to teach vocabulary. 
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Chapter VI 

DISCUSSICB OF THE HBSUIflS AHD THEIR IMPLICATIONS 



Need for Caution i n Interpreting the Results 

When the CRAFT Project was first planned, months before work 
began with teachers and pupils, the planning group was in full agreement 
that the results of the first year of the rtudy were unlikely to provide 
conclusive results. One of the reasons for this conviction was the know- 
ledge that the teaching methods selected for use would not be equally 
familiar to the teachers. It was expected that the Language-Experience 
teachers would take longer to become comfortable with their approach than 
the Skills-Centered teachers. This was certainly borne out by the observa- 
tions of the consultants and research staff. Ihe Audio-Visual Method did 
not really begin to differentiate Iran the other Langaage-Sxperience Method 
until January, and thus was the last to become fully operative. 

A second reason was familiarity with the outcomes of many previous 
studies of reading readiness and beginning reading instruction, in which 
apparently strong differences in favor of one procedure at the end of the 
first grade seemed to fade out and sometimes to reverse themselves by the 
end of the third or fourth grade. Accumulated evidence is abundant on the 
need to study long-term as well as short-term results of teaching procedures. 
This seemed especially true of work with disadvantaged Negro children, with 
whom intensive large-scale research has just begun. 

A third reason was a suspicion that available reading tests, in- 
cluding those prescribed for the cooperating studies, tend to be inherent- 
ly biased for or against particular teaching procedures. As an exanple, 
one may consider the vocabulary utilized in a test like the Stanford 
foffS lj ry manual is not specific as to the source of the vocabu lar y 

used, but by inspection it seems to emphasize the words commonly taught 
in basal reader series for the primary grades. These are certainly words 
that children need to be able to read. Children taught by Language- 
Experience Methods, however, learn to read many words imbedded in their 
social experience, which are outside of the core basal reader vocabulary. 
Present tests do not attempt to sample this large, uncontrolled vocabulary. 



* ** 6114 ° f *• S£COnd 0r ****■ ««<*«» the total vocabularies 

or the tvo approaches should be far more alike as each broadens its 

areas of reading, and test bias for or against a teaching method should 
be less of a problem. 

A different kind of bias can be found in the word list tests. Two 
of then were specifically designed along lines that should produce bias 
in favor of methods that stress phonetic or phonemic principles. 

Ihese three concerns - unequal starts, delayed effects, and biased 
s s - caused us to begin planning continuation and replication s tudies 

The Continuation Study 

A proposal to continue to study the CRAFT children througi the 
second and third grades has been approved by the U.S. Office of Education 
for support, and is now approximately half-way through the second grade 
Eleven of the original twelve schools are participating. There are 38 
second-year CBAFT classes, divided almost evenly among the four teaching 
methods. An intensive teacher-training program has been designed to keep 
the four methods distinctly different through the second year. Continuity 
of controls and experimental precautions is being maintained. 

In the third grade no attempt will be made to keep classes together 
or to control teaching procedures. The majority of the children will have 
moved to different schools. Procedures have been set up for tracing them 
to obtain their scores on the city-wide reading tests. 

jfoe Replication Study 

A replication of tue first-grade study is also being conducted, 
with support from The City University of Sew York and the Board of Educa- 
of the City of Hew York. Twenty- six first-grade teachers are Qnploy. 
ing the same methods they used last year, each with a new class of childr en. 
In-service training and supervision are being continued, but at a less 
intensive pace. Pretests were administered early in the year and posttests 
will again be used after l 4 o instructional days. 
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Tte replication study will, it is hoped, provide a Bore valid test 
of the first-grade methods than was possible in the present study. With 
a year of training and experience behind them, the teachers should be 
able to demonstrate what each method can produce in the hands of competent 
teachers trained and experienced in its use. She excitement of the first 
year (and its unmeasurable Hawthorne effects) has died down, and the out- 
comes should represent more fairly what would happen if the method were 
officially adopted. 

The Pilot Study 



Pour of the CRAFT first-grade teachers are currently trying a new 
combination method of teaching. This is a combination of the language- 
Experience, Audio-Visual Method with the Hwnovisual word attack program. 
The results which the same teachers achieved in 1964-65, as well as the 
results of the Replication Study, will provide a basis for evaluation. 

Tenta tive Nature of Present 



The present report is, therefore, a progress report or. the first 
year of a three-year project. Any conclusions presented in Chapter V, 
and summarized in Chapter VII, must be considered tentative and subject 
to further testing in the continuing project. 

Impatience for the immediate application and dissemination of 
research findings is understandable. Pressure from school systems and 
upon school systems fress interested citizens,has been growing in intensity. 
In a research area as vitally important as beginning reading instruction, 
the temptation to be content, with short-tens results is very strong. But 
the cosplexities of doing valid research in this difficult area are many. 
Patience in holding out for long-tern effects, and willingness to tty, try 
again, should eventually produce results that will be fins and dependable. 




Comments on the Teach-fng Methods 



The Two Main Approaches 

At the beginning, there me considerable difference between the 
reactions of the teachers in the two approaches. 

The teachers in the Skills-Centered Approach in general developed 
routines quickly and felt relatively comfortable and secure because they 
had very specific directions on what to teach and how to teach it. They 
had scope for resourcefulness and initiative in the teaching of social 
studies and science, in which they were permitted to use an experience 
chart procedure for recording what the children had learned as long as 
they did not use them for reading instruction. They were also encouraged 
to utilize story-telling, show-and-tell periods, and dramatizations; and 
to provide for supplementary independent reading as the children became 
ready for it. They were to employ an enriched Skills-Centered Approach 
rather than an impoverished one. 

The Basal Reader teachers reported problems in class management, 
in the handling of reading groups, and in using the full allocation of 
time. They also had to get used to following the manual closely and to 
getting effective returns from the workbooks, which seme tended to use as 
busy-work rather than as skill-development practice. 

The Rionovisual teachers responded with a good deal of enthusiasm 
at the beginning. They were pleased to have materials that the other 
groups were not allowed to use, and they found the teaching method clear, 
explicit, and easy to follow. Having the fhono visual practice period at 
a different time of day from basal reader activity made daily planning 
comparatively simple. As the year wore on, some dissatisfactions developed. 
The daily skills practice began to seem repetitive and monotonous. Seme 
children learned letter sounds by rote, without developing insight into 
word analysis. Others could write words correctly from dictation but tiri 
could not read them. On the whole, however, the morale of the Hionovisual 
teachers remained fairly high. 

During the first two months of instruction, the teachers in the 
Language-Experience Approach expressed many dissatisfactions. Relatively 
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few had any background for this approach, and both the rationale underlying 
the procedures and the working out of details day by day were unfamili a r . 

In the workshop sessions many complained that the directions they were 
given were not specific enough. They wanted detailed recipes to follow. 

They found it hard to accept and act on the principle that a main purpose 
of teacher planning was to release spontaneity of language expression in 
the children. They needed to be led step by step through the stages of 
selecting a group experience, preparing for it, discussing it with the 
children in advance, getting children to observe and remember the experience, 
discussing it afterward, and crystallizing expression into charts for read- 
ing and writing. The idea of encouraging children to talk and write about 
topics that were of individual interest and to help each child with the 
special words he wanted to learn, also came slowly. By the Christmas 
vacation, however, most of these teachers had made progress in mastering 
the approach and their morale had improved accordingly. 

Audio-visual equipment began to arrive in the L.E.-A.V. classrooms before 
mid-year, and training in its use was instituted. For each new piece of 
equipment, the use of the machine had to be taught, relevant materials had 
to he ordered and distributed, and ways of using it for reading instruction 
had to he developed and disseminated. The L.E.-A.V. Methodology developed 
constantly as new ideas and procedures were added. 

Tentative T^lications of the Besults 



Mb* "swm 



A number of tentative conclusions can be drawn from the first year 
of the study. 

1. The results of the CRAFT Project as a whole shew that dis- 
advantaged first-grade Negro children can make substantial 
progress in learning how to read. The pupils as a group had 
done quite poorly on the reading readiness tests. Their achieve- 
ment was well ahead of expectations based oa their pretest scores. 

2. Disadvantaged urban Negro children can learn to read by the same 
methods that work with middle»class white children. They begin 
with extremely poor auditory perception skills, limited voca- 
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bularies, end other readiness handicaps, hut they can respond 
to superior teaching with good learning. Wien boohs and stories 
are within their comprehension, they respond well to naay of the 
sane boohs that are favorites with middle -class children. Their 
new integrated favorites with axulti-ethnic characters are probably 
gaining popularity among middle-class children also. 

3. The Basal Reader Method, employed as in the CRAFT Project, held 
a slight lead among the four methods at the first-grade measur- 
ing point. It achieved slightly but significantly highest 
results in meaningful silent reading comprehension. It was 
significantly highest also on the San Mago Inventory of Pupil 
Attitude . It was jj-elativeiy less impaired in the split- session 
schools than the Audio-Visual Method, which was the only Language- 
Experience Method with split- session classes. 

4. The Fhonovisual Method, although liked by its teachers, did not 
demonstrate any superiority. It was inferior to the Basal Reader 
Method in paragraph meaning, and its slightly higher scores on 
word recognition tests were not statistically significant. It 
was the lowest of the four methods on the San Diego Inventory 

of Reading Attitudes. 

Chall, in a detailed survey of research on first-grade reading 
instruction, concluded that systematic >i phonics instruction has 
a delayed effect with disadvantaged children; that It does not 
do well in the first grade, but shows to advantage by the end 
of the second grade.* It is possible, therefore, that the 
Phonovisual method will demonstrate accelerated gains in the 
next progress report. 

5« The Language-Experience Approach with Audio- Visual supplementation 
obtained significantly higher scores on several tests than did 



*Chall, Jeanne, Learning to Read: The Great Debate « Vols. I and II. 
Final Report of The City College-Carnegie Reading Study (1962-65). Rew 
York: The City College of The City University of New York. 
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the Language-Experience Method without audio-visual supplementa- 
tion. In grade-level scores the A-V Method matched the means 
of the Skills-Centered Approach on most of the reading tests 
and surpassed it on one test. The L.E.-A.V. Method requires 
expensive equipment and intensive training of teachers. It 
also did poorly in split- session classes. But present results 
fully justify continued explorations of the ways in which the 
use of audio-visual procedures can enrich reading instruction. 
Considering hew long it took to get the A-V Method operative, 
its results are very encouraging. 

6. The slight hut statistically significant lead of the Skills- 
Centered Approach over the Language-Experience Approach is due 
to the L.E. Method's relatively poor showing; the L.E.-A.V. 

Method matched the Skills-Centered results. The differences, 
even when statistically significant, were not large and might 
disappear or be reversed during the second grade. 

7. In the schools in which the CRAFT classes were on split-session 
schedules, achievement in both approaches was considerably lower 
than in the full-session schools. The implication is clear that 

split-session schedules for first-grade classes should be abolished 
as soon as possible. 

8. Adequate control of instructional time is essential if controlled 
research on methods of instruction is to have any validity. 

Despite strenuous effort in the training program, there were both 
wide differences in instructional time within each method, and 
significant differences between the approaches. Furthermore, 

the amount of time spent in direct reading activities was one 
of the few variables positively correlated with outcome measures. 
The Teacher Log (which is new available in a version that can 
be automatically scored and punched into data cards by an I.B.M. 

1230 Visual Scanner) demonstrated its usefulness as a research 
tool. 

9. When a new way of teaching reading is to be tried, an intensive, 
continuing in-service training prog* 'am is necessary. With a 
workshop that met once a week during the early months and every 
two weeks afterward, with each rroup 0 f four teachers receiv- 
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tog a haif-tay per week of reading consultant help, the CRAFT 
teachers learned to teach according to the methods assigned 
to them. The four methods were clearly distinct according to 
the logs, the OScAR, and the Saa Diego Bnrentorr of App-ea,.*., 
to the Teaching of Read •trip , 

10. After the posttest results had been corrected for initial 
differences to readiness, the posttest means in sane CRAFT 
classes surpassed the national noma, while the means in other 
classes were very low. The implied need for further study of 
what ashes soma teachers more effective than others is clear, 
and will be discussed further to a subsequent section. 

Difference s in Teacher Effectiveness 

The large and significant differences to the result-getting ability 
of individual teachers cut severely across the relationship between teach- 
ing method and results. The analysis of variance tables all showed very 
large residuals, attributable in large measure to differences aa»ng the 
teachers within each of the methods. The range to corrected means within 
each teaching method was far greater than any difference between methods. 

toe development and use of CScAR-R was based on the hope that it 

would tap dimensions of teacher behavior that are significantly associated 

with good or poor learning on the part of the children. That it failed to 

show significant correlations with the posttests results was a real dis- 
appointment. 

Teachers in split-session schools did not achieve as good results 
as teachers in full- session schools. The curtailment of time and the 
need to turn the classroom over to another teacher each day seemed to 

impair the effectiveness of Language-Experience Audio-Visual teachers more 
than that of Skills-Centered teachers. 

Another significant time factor was the amount of time per day spent 
directly in reading activities. The positive eorrelations between reading 
time and posttest results were substantial, and indicated that regardless 
of method, teachers whose pupils spent more time in reading activities 
tended to do better than those whose pupils spent less time in reading 
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activities. The amount of time spent in supportive or related activities, 
on the other hand, did not correlate significantly with posttest results. 

Aside frcn these clues, the present study does not provide evidence 
to explain why one teacher can get superb results with a particular teach- 
ing method of instruction gets poor results. 

This problem looms as one which must be solved if teacher training, 
both pre-service and in-service, is to produce any significant improvement 
in the preparation of those who are to teach beginning readers. 

Possible Generalization of the Results 

One of the original objectives of the planners of the CRAFT Project 
was to conduct the study in such a way as to allow maximum generalization 
from the results of the study to large-scale applications in schools that 
have substantial numbers of disadvantaged children. Some of the vteps 
taken to implement this policy were as follows: 

1. The schools were public New York City elementary schools, 
varying greatly in age and physical facilities, located in 
depressed Negro ghetto areas. 

2. The teachers were regular New York City elementary teachers. 

The only criteria used in selecting them were that they were 

willing and likely to remain in the school to the snd of the 
year. 

3. The children were chosen at random from among the first-grade 
entrants. In the school with the least disadvantage, two 
"high" classes were removed and the CRAFT children were chosen 
from among the rest. Both children with and without kinder- 
garten experience were included. 

h. The teaching methods were chosen to represent opposed theoreti- 
cal posits of view that are widely held. 

5. Classes were kept at the average size of the non-project first- 
grade classes in their schools. The average class register 

was approximately 33 pupils, and seme teachers hod between 35 
and 40. 
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6. The classes were supplied with the materials normally required 
for good teaching with the method. With the possible exception 
of some of the audio-visual equipment, the costs for Materials 
^ere well within the financial capability of an adequately 
supported school system. 

7. The amount of training and supervision provided was considerably 

• more than is typical. It is becoming increasingly evident that 

similar training and supervision are essential if teachers are 
to learn how to work effectively with disadvantaged children. 

In the opi ''ion of the project staff, the seven points detailed 
above justify the expectation that the final results will be generalizable 
to the education of disadvantaged urban Negro children, both in New York 
City and elsewhere. 
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Chapter VH 



SUGARY AKP CQWCmSTOWa 



This report is a progress report describing the first year of the 

e-year CRAFT Project, a comparison of methods of teaching reeding to 

ycnng disadvantaged Hegro children. The project is veU into the second 

grade, and will continue through the third grade. The first-grade results 

are retried as tentative and inconclusive in regard to the relative merits 
Of the instructional procedures. 

fir t JL' CRWT Pr ° dSCt 16 °” ° f thS cf *«*««<* Projects on 

first-grade reading supported by the U.S. Office of Education. The pro- 

r h ir:; t0 the “ Utt " effeCti ™ e - two major approaches 

cltel l ”*?f t0 di8adVantaged «*•» ^Udren: (U the akills- 

»as triedlrfth J 8,13 2 ^ lan ® uaee ‘* xperience approach. Each of these 

o variations, making four treatment methods in all. These 

four treatment methods were as follows: (a) a skills-centered method using 

as readers, with close adherence to the instructions contained in the 

eacher-s manuals; (b) a skills-centered method utilizing basal readers, 

but substituting the IWvisual method of teaching work attack skills 

for the work-attack lessens accompanying the basal reader; (c) a language- 

^erience method, in which the beginning reading materials were developed 

the oral language of the children; and (d) a language-experience method. 

with heavy supplementation of audio-visual procedures. 

f 1 ® ba3iC C ° nflict betHeen the two najor approaches is between two 
quite different philosophies of education. The skills-centered approach 

emphasizes the need for order and structure for disadvantaged children. 

In this approach skills are introduced in specific pre-ordered sequence, 

“ * TOC Tr UMd 18 CarefUUy ° 0Rti ' 0Uei - 111 language-experience 

PP ch emphasis is placed upon ego-building procedures in the classroom 

an on language and experience enrichment. The child’s oral production, 

bitten dewn, supplies the beginning reading materials, and reading skills 

eve op as part of the language development of the child. 



Procedures 



Population 



Twelve elementary schools were selected with the assistance of the 
staff of the Hew York City Board of Education on the basis of a very high 
percentage of Hegro children, a minimal of six first grade classes, and 
evidence of cultural deprivation and narked retardation in previous surveys 
of reading ability. Cf 1,578 children in 48 classes who completed the 
pretests, 1,146 remained to the conclusion of the first-grade testing. 

There was random assignment of the four methods to schools, two methods 
to each school, random assignment of teachers to the two methods within 
a school, and finally, random assignment of pupils within each school to 
the two methods. Care was taken to identify children with and without 
kindergarten experience and to balance their assignment! to the methods. 

Teachers 



The teachers were recruited as volunteers by their school principals, 
with the understanding that they would accept any of the four variables 
that would bo assigned to them by lot. They varied greatly in age and 
experience. A small stipend was provided for the extra work and after- 
school time involved. Training workshops for the four methods smarted 
in June of the preceding year and continued for twenty-me sessions during 
the year j In addition to the workshops, the teachers were visi'ced period- 
ically by the assistant director of the project and by the six consultants. 
Guidance and help were given in developing the unique features of each of 
the four methods. 

To check on the use of time, all teachers kept a log for five days 
each month, indicating the number of minutes spent on Reading and the 
other Language Arts. In addition, a special observational schedule called 
OScAR-R, constructed by Ur. Donald M* Medley, was used as a basis for 
objective observations of teacher-pupil interaction and of materials used 
during representative lessons. Each teacher was visited eight times, twice 
by each of four research assistants . 
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Tests 



Diagnostic ftmuHn. 

Tburstone ~^±tc ra C^Hnf, T ~’ * S SE S lltan Beadiness Test (pertial 

Sas^lMiera.e'ifS: pw “ t ^ *° T final teatiE S «* 

and tiro writing tests were giveiTt o ^ Rf ^ j 5 £j£at, three word lists, 
for each of the four methods. children, M 



Results 



a results of the first year of the CRAFT Project have been 

r-r “ “ uu “ «— »• - •— *„ 

as they b ' T” ^ ^ P0int th «y will he briefly summarized, 

were Us^ a “ “* three — questions that 

were listed as specific" objectives on page 6. 

The major questions were Questions One tta'ough Five 

«... . -an-* «*«. » „„ 

After outcome measures were adjusted to eliminate differences in readi- 
er rr^r ^ StatiStl ° aUy Signifi “ nt differences in 
° f Skills-Centered Approach when all twelve classes were 

included. When the analysis was restricted to the nine schools with 
f , c /! i eSS , l0n 8Chedules ' Skills-Centered Approach was still si<nji- 

a — * . u „. zl. 

zne baills-Centered Approach* +h* T * 

accounted for «, ’ regular ton ®“««-Bxperience Method 

the Obtained Zl betTOen the *» -to approaches. Most of 

the obtained differences amounted to only one-tenth of a year in grJe 

score j and therefore vere of little m t 

statistically significant. consequence even when 

1)0 P “ Pil gailis 10 fading under Skills-Centored t eaching 
differ wbon the Basal ^ 

Basal Reader c«oT ™ t0 ^ ^ 



Ill- 



Ihe Basal Reader Method surpassed the Fhonovisual Method in silent 

C T eh0nSi0!! ' 41113 WB3 significant 

ifferenco between these two methods in reading skills. The Basal 

Reader Method was also significantly higher than the monacal Method 

n the San Diego Inventory of Pupil Attitude, showing s»re favorable 
attitudes toward reading, 

. 1)0 gains by pupils given ^nguage-Experience teaching depend 

on the amount of audio-visual enrichment? ' 

When the comparison was restricted to the nine schools with ftOl-session 
schedules, the Audio-visual Method had higher Beans than the regular 
Xanguage-Rxperience Method on all seV en of the measures for which adjust- 
ed Means were available. Pour of the differences were significant ; L 
others were within the range of chance fluctuation. The two Methods 

different on 4116 lnveD4oiy whioh measurea attitude 

The Language-Experience -Audio-Visual teachers were somewhat delayed in 
receiving their equipment and in learning how to use it, and spent less 

. ? Jf t0tal langUa8e aitS instrttotion I" time spent in reading 
ctivities than did the other Language-Experience teachers. These two 

conditions enhance the importance of the achieve»ent of the Audio-Visual 
Method • 

telionjK DO any of these methods of teaching tend to produce greater 
pupil gains in some skill areas than in others? 

Hone of the methods outstripped the other three methods in all respects 

reading comprehension and in attitude toward reading. The Phonovisual 

Method had snail and non- significant leads on seme tests of word recogni- 

tion. The Audio-Visual Method was first on measures of spelling and word 

S y s ills, but not significantly. The regular Language-Experience 

Method was lowest on all seven adjusted measures. , On all measures, 

even the statistically significant advantages were small, 

Question 5 * Does the amount of suc^e^R a v . , , 

success a teacher has with a method depend 

on how faithfully she uses it? 

Degree of conformity to one of the four methods was measurable in three 
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voys • The Teach er the QScAR— R ^ and the San Diego T each er Inventory 
all provided scores related to the specific teaching methods. When these 
various scores were correlated with the adjusted class means, the coeffi- 
cients were generally not significantly greater than zero. There is no 
evidence in this study, therefore, that conformity to the details of a 
method is necessarily productive of superior results with it. 

There were also three minor questions listed among the objectives. 

Question 6. What measure, or combination of measures, obtained at the begin- 
ning of the first grade is the best predictor of achievement in reading for 
this population? 

The CRAFT children showed clearly the effects of disadvantaged upbring- 
ing in their performance on reading readiness tests. Their mean scores 
ranged from the percentile to the 44th, on various reading readiness 
tests; their median was at the 23rd percentile. Their poorest showing 
TOS on Murphy- Durrell Phonemes (1st percentile) and Metropolitan Word 
Meaning (l4th percentile). 

errors in test administration had invalidated the scores 
of several whole classes on four of the five Murphy- Durre II 1 scores and 
on the Thurstone Identical Forms test . Among the four tests on which 
usable scores were obtained from all classes, there was little basis 
for choosing. These were Murphy-Durrell Learning Rate, Metropolitan 
Word Meaning and Listening, and Thurstone Pattern Copying. These four 
tests all had correlations with posttest scores that were significant 
but low. Their very low intercorrelations indicated that the four 
tests were measuring different aspects of readiness, and made possible 
the substantial multiple correlation with the posttests. 

Because of the necessary elimination of some of the readiness measures, 

the data from this study do not provide a satisfactory answer to Question 

6 . 

ifeegtion 7* What characteristics of books determine pupils* reactions to 
them? 

The CRAFT children liked both children* s classics and comparatively new 
books that have become established favorites among middle-class children. 
Tney also tended to be attracted to books in which people with dark 



/ 
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complexions were pictured, but multi-ethnic illustrations did not 
»ate a book popular if the content w»s dull or incomprehensible. The 
teacher’s Banner of presenting the story was of considerable importance, 
. question 8. What is the relationship of age, experience, training, and 
other teacher characteristics to success in teaching reading by each method? 

Very marked differences in teacher effectiveness in all four teachin g 

methods irere revealed in the very wide range of adjusted class means 

for each method, and in the very large residuals (attributable largely 

to class differences within methods) in all of the analysis of variance 
tables . 

In addition to the information obtained about teacher age, education, 
experience, and attendance, a large variety of scores were obtained on 
subscales of the Teacher Log, the OScAR-R, and the San Diego Teacher 
Inventory. Correlations of all of these scores with adjusted class 
means on the posttests failed to turn up any r^s of usahle size. The 
one fact positively established is that the teachers who spent more time 
in direct reading activities tended to have better pupil achievement 
as measured by the posttests than teachers who spent less time in reading 
activities and more on other Language Arts activities. 

Two other findings, not included in the original objectives, are worth 
noting here. 

The first is the fact that in all of the Methods tried, most of the 
children made a substantial start in learning to read. Considering 
their low performance on the pretests, their achievement on the post- 
tests seems to the project staff to have been quite satisfactoiy. This 
may very well have been due more to the intensive teacher training 
program than to the specific teaching methods. 

The second finding was an outcome of the fact that three of the CRAFT 
schools had to go on split-session schedule. The split-session classes 
were significantly lower than the full-session classes on most test- 
for all methods. The Audio-Visual Method was the one most adversely 
affected in the split- session classes. The desirability of providing 
disadvantaged children with a full day in the first grade has been 
clearly demonstrated. 



The relative Merits of the tiro approaches and four teaching methods 
employed in this study have not yet been established. The CRAFT 
Project viil continue until the original first grades will have 
finished the third grade. Further light concerning the guiding 
questions will be sought as the study progresses. The final report 
is planned for January, 1968. 



that most of the A-V equipment should be in the A-V classrooms by the 
end j of November. This was to include for each A-V class: a phonograph, 
film-strip projector, a wall screen, a tape recorder, an overhead pro- 
jector, earphones, a connecting box, and sharing the use of a motion- 
picture projector, a Polaroid camera, and a Kodak camera. There would, 
in addition, be access to a Thermofax copier for reproducing materials. 
Materials in each room would include film-strips, tapes, transparencies, 
and photographic film. CRAFT classes would also have priority in leas- 
ing 1 6 mm films from the classified lists. An annotated list of Ap - 
proved Audio-Visual Resources Applicable to CRAFT A-V Classrooms in the 
Language Experience Variable was later distributed to A-V teachers. 

It was agreed that the reading specialists would view all audio- 
visual materials before they were ordered for the schools, and that 
there would be a team approach to the project so that viewpoints and in- 
sights might be shared. Caution would be exercised against such mas- 
sive concentration of audio-visual materials that general applicability 
of CRAFT project procedures would be vitiated because they would not be 
practicable in public school situations in New York City. 

In planning for the preparation of special audio-visual mater- 
ials for each A-V classroom, it was agreed that such local material 
would be coordinated with the language- experience approach of the pro- 
ject and would hare relevance to the experiential base of the children 
and to the accepted rationale for concept development in each L.E. ex- 
perience classroom. 

If the physical aspects of the roan permitted, every classroom 
was to have a viewing corner and a listening corner. The equipment in 
the viewing comer would be a film-strip projector, wall screen, the 
overhead projector, and the motion picture projector. The equipment in 
the hearing comer would be the phonograph, the tape recorder, the ear- 
phones and the connecting box. 

BAvP s contribution toward the development of local subject 
matter material would depend on the interest, the social background, 
and the language of the children, and would be used to bridge the gap 
between the level of their language and book materials. Constructing 
new materials based on the culture and language of the children would 
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M&40 TO: Teachers and Consultants 

(Attentions Principals and Assistant Superintendents) 
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your own migrations! 116 f °“ ° f daUy log ' whioh ^“^rates many of 

, . i® designed to record total time spent on discussion listAn-inry 

reading and writing in Social Studies and Science! as 

vnHnMoD . J? e to J al time & ven *> this combination should be the same in all 
variables, three hours a day in our five-hour schools and two and one-half 
hours a day in our four-hour schools* one-natr 

Basal Reader Teachers ( with and without Hjono-Vianai ) 

breakdown reSn!f te8CherS USinS * ^ reader * ethod the *tUr 



Language Arts - Total 
Reading (5/4) 

Other Language Arts (l/4) 

Social Studies 

Science and Health 

Total 



5 Hours 


4 Ho ’^s 


120 min. 


100 min. 


90 " 


75 " 


50 " 


25 " 


50 ” 


25 n 


50 " 


25 " 



180 min. 150 min. 



i . . . 1116 time s P en ‘ t may ve il vary from day to day, but should average 
close to these figures for the week. snouia average 



5<1 Experience Teachers (with and without Audio-Visual Sueelmentatlon] 

. m . . . . .P 16 tochers in tbs language experience variables should devote the 

■PM. tine 1,0 the coablnation of language 4rts, Social Studies, and Science 

This means an average of three hours a day for the total complex in oSTfive“ 
hour schools, two and one-half hours in our four-hour schools. 

Tng, apeak^S^^^ 

I^gu^'Arts'cafbrSSibS? ° f Beading ** the <*»<* 




Teachers and Consultants, etc.: 
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December 50, 1964 



Concerning Audio-Visual Experiences in all Variables 

Most audio-visual experiences are planned to be part of the instruc- 
tional program of Language Arts, Social Studies or Science, and should be in- 
cluded in the tir ~ allotment unless specifically outside of the experimental 
variable, e.g., arithmetic. 

Field Trips 



When field trips are made, time spent in preparation before the trip 
and in discussion and follow-up activities are counted in the relevant curriculum 
area, but time spent outside the classroom is not counted. 

Change in Number of Logs to be Submitted 

As indicated in the postscript to my letter to you dated December 25, 
1964, the number of logs trill be reduced to five a month. Let us make it a 
record of the third week of each month. In January, we hope to receive daily 
logs for January 18th to 22nd. Will the one person appointed in each school 
please continue assuming responsibility for mailing these to our office so that 
we may receive than before the end of each month. 

Next Session of In-Service Course : January jl8th at Hun ter College H«8# in the a 

signed rooms at four o’clock. 

The consultants and 2 look forward to meeting with you again. We 
hope that because of this type < f written communication about technical matters, 
we will find it possible to spend the vast bulk of the session on discussion of 
the individual variables and instructional problems which inevitably arise. 

Since January l8th will be the first day of log-keeping under the 
new system, you may have some questions and comments you wish to make. These 
comments should have pertinence to all teachers on the project. For questions 
which concern your local situation only, please consult privately either your 
district reading consultant or myself. 



BIS:bmt 



Blanche L. Server, Coordinator 



Enclosed: 20 copies of the new Daily Log Form, a quantity sufficient for four 
months . 




Teacher 



The City University of New York 
Division of Teacher Education 

OFFICE OF RESEARCH AND EVALUATION 

CRAFT' Project 

New Daily Log Form 



Class 



School 



Date 



. dot down the starting tine and stopping tine for each activity you 

employ during the day, at the completion of the activity. If there is more than 
one period for a particular heading, put down the tines for each period. 



Reading Activities 



Tine3 



* 



Summary 
in Minutes 



t 



Basal Reader Activity 


t 




Experience Chart 


t 

# t 




Sight Word Drill 


1 

f 




Phonic Activity 


f 




Other Reading Activities (Specify) : 


T 

I 




Supportive Activities 


t 

t 




Story toiling or reading (by teacher) 


t 

t 




Discussion 


t 




Writing 


t 

t 




Audio-Visual activity 


t 




A-V with intermittent discussion 


T 

i 




Dramatization 


t 




Art work with reading 


t 




Other Language Arts (Specify) 


t 





which have separate periods 

Social Studies 



Science 



Hew First-Grade Teachers Spend Their Time Teaching 
Language Arts to Disadvantaged Urban Children 

AWmIi* T — a... "» « ** a a aw waa - 

**• ocjt wci' ouu rtioerx u . narris 
Division of Teacher Education 
The City University of Hew York 



Presented to 

American Educational Research Association, Chicago, February 19 , 1966 



Problem and Objectives 



The difficulty encountered by disadvantaged children in learning to read 
has become one of the nation’s most provocative research problems. There emerges 

dlscover effective ways of teaching the culturally different 
child, introducing the Language Arts in an orderly, sequential fashion. The most 
appropriate sequences and time allotments are goals for future research. 

, A p r oblsm arisec as t0 wha t is happening in classes of disadvan- 

oged children today? What are teachers doing when they say they are teaching 
the language Arts? How are they dividing the time allotted to this inmortant 
area of the curriculum at the present time? These questions arose as by-products 

i ? u fir ??“ gr ^ e readiD «- ’ am a unique opportunity was presented to 
allocation of time to the various aspects of the language arts, 

b ? L large groi ^ ) of teachers of first-grade disadvantaged 
children living in ghetto areas of Hew York City. 



Procedures 



Methods in the Studv 

11 ■ 1 MU 11 

At this point a short description of the reading study called the CRAFT 
r*oject seems necessary. Figure 1 shows the teaching methods that were used. 



This report is based on data collected in Project Ho. 2&TJ of the Cooperative 

Education, U,S. Department of Health, Education 

of th^Citv t0 the project b y the Board of Education 

°u aru - Division of Teacher Education of The Citv Universitv 

whose Office of Research and Evaluation is conducting the research. y 
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Skills-Centered Approach 



24 Classes 



I 


n 


Basal Reader Method 


Basal Reader Method with 




Phono visual Word Recognition 


12 Classes 


12 Classes 

' 



Language-Experience Approach 



24 Classes 



Language-Experience Method 



12 Classes 



Language-Experience Method with 
Audio-Visual Supplementation 

12 Classes 



Figure 1. Two Major Approaches Subdivided into Four Experimental Methods 



i;*? e (Comparing Reading Approaches to First-Grade Teaching 

with Educationally Disadvantaged Children) is one of the*" coordinated" research 
projects in first-grade reading currently receiving support from the Cooperative 
™!^ C ^^ 0gram *-n_ Tha central comparison is between the Skills-Centered Approach 
and the Language-pcperience Approach. The Skills-Centered Approach emphasizes the 
need for order, structure, and built-in repetition. Skills are introduced in 

fn e 5 U Z n 4 ^ vocabulary is car - full y controlled, and the teacher is pro- 
vided with detailed lesson plans. The Language-Experience Approach emphasizes 

the need for self-expression through the use of the child’s oral langSge as a 

?f 6inning re f d j ng “ aterials . 318 experienceeprovide a basis for concept- 
^ 1 +? ine, language enrichment, end vocabulary develcpment. Out of the discussion 

Chart stories are deVGl °Pcd and used for reading and writing, 

fnd SdMdSiMd! f ° r aXm * tTmBition t0 reading is gradual 




3 . 

* 

?^ ch *5??® ' two approaches is further divided into two teaching 

f 8 ^-Jivided into Method I, Baeaf Header 

S-f * ? used 

manuals 8 The 8 ?^,.^ l£* Ce 1 0f th T word recognition lessons contained in the 
manuals. The Language-Experience Approach was subdivided into Method ttt 

Ianguage-Enperience with customary use of audio-visual tecta£o*v ^iShnd tv 
Jjaaguage-Experienoe with heavy supplementation o^So^SShX" ’ 

Population 

teachers°nartioiTia+os in eaoh of the four treatments, 48 first-grade 

w™ l socio-economic Negro children, in twelve schools located ii ftoee 
as ^ill service” sch^s^f® se |? 00l8 J ith one exception had been designated 
cause of the high incidence of cultural deprivation and instructional probl^T ~ 

Method of Collecting Tto+.o 

experimenta] 1,1 teacMn S ta equalized among the four 

experimental methods in order to eliminate a potential source of uncontrolled 

schools'were raTfSl 2T obl ?“ that h ? d to te solved was that nine of the twelve 
sessions A Ti„-n„ * fi y e ’ ll ° ur sessions and three were on part-time four-hour 

spent onEetliS^J e r er LT* bherefore designed to record the total time 
total time on sportive language Arts activities. The recommended 
the d ^ is combination was established as three hours a dav f or 

schoS^? “ S “ d tH0 8114 “ours a day in theXee %L-Zur 

te ^ eTB O 3888 * Bc^er and Phonovisual Methods) the 
lonowing use of time wes designated: ' 



Language Arts - Total 
Reading 

Other Language Arts 

Social Studies 
Science and Health 



5 Hours 

120 min. 

(90 min.) 
(30 min.) 

30 min. 

30 min. 



h Hours 

100 min. 

(75 min.) 
(25 min.) 

25 min. 

25 min. 



Total 



180 min. 



150 min. 



< jjnG t J ie La »guage-Experience methods the proper allocation of 

ouTor^r^ c 8 o^ ss s ~ 

lealth. The Language -Experience teachers were therefore asked to devote th»° e 
t0tei t 180 *• f dve-hour schools «JmoESE forlol-S ^lsT 






k. 

f 

balW'of nr SS thercfOT6 ’ the 

a «eaaing and the other Language Arte was flexible. 

Number of Lo^s 

nanbef^Sg^alSL 1 !!^!? echo01 «* *» ac^*er and December. The 
(T the teX^ .™™.^ 4 *° ««wecutive days a month for two reasons: 

Format of the Log 

«rmrJJ!i!! *°8 forn was tried out in one school and then miaeoeranhed 

suggestions. checking, totaling ^^frtikical 

“d T tbere fi -vi 8e n E a r^“annin 

and continuation studied **”'* ^ Ucatio “ 

t .„ . can be s “ n *0“ these forms, the log was designed to elicit from the 

I^^^r’tortd^i^he 0 ^ 8 ” 1 ^ 8 th \ time 8pent in 811 c^scta of the 

categories of Reading Activities and 

t^lanmuamArt^^n +h S £i i81 ?^* S 8113 Scienoe > »hich were integrated into 
2so iS^ methods of ^ language -Experience Approach, were 



Accuracy of the SQg a 

the teachers 8 * m ?° Z** 11 * the accuracy «* the times entered by 

nhJJz'”' Clossroan appraisals by sigierviscrs and reports of objective 

errors concurred in confirming the seriousness with which the logs were rem&nb 

2 a^ c r^ iorwh imeva > the r “cSch »^o^r 

Of the two other" columns for activities covered in the specific catemorieT 
in the^S°aasses. a0t nuDSro “ B » espseia111 ' » ten cos^ared to t be total time spent 



Results and Discussion 



Table I presents the average daily instructional 
two major approaches and the four teaching methods. 



time in minutes for the 



Table 1 



Average Daily Instructional Time for 
Two Approaches and Four Teaching Methods 



Variable 


Time in 

Minutes per day 


Skills-Centered Approach 


171.5 


I. Basal Reader Method 


172.1 


H. Phonovisual Method 


170.8 


Language-Experience Approach 


175.9 


III. Language-Experience Method 


194.0 


IV « L-E Audio-Visual Method 


157*8 



It is apparent that the difference between the instructional time devoted to the 

ZLZln a PP ro&c bes (l71.5 ^ 175.9 minutes) is negligible, and that both are 
reasonably close to the goal of 180 minutes. 



. o , disparity between the Language Experience methods. with and without audio- 
visual supplementation may be in part an artifact of the method of reporting, since 
it seems probable that time spent with A-V equipment was omitted from the log by 
seme teachers , although preparation and ensuing discussions were included. Another 

possible explanation is the slowness with which the Audio-Visual Method became 
xn^>X6iii02it 6d • 



The teachers encountered difficulty in becoming accustoased to the CRAFT t im e 
allotment, which was considerably greater than the time suggested far the Language 
Arts In the most recent Board of Education Curriculum Bulletin No.l, i.e., 90 to 

120 minutes per day for the Language Arts, of which only 30 to 45 minu tes are desig- 
nated for Reading. 

Figure 2 shows the progress month by month of teachers of the four methods in 
approximating 180 minutes per day. The Audio-Visual and Basal Reader teachers 
started low and reached the desired level in March • The Phonovisu&l teachers showed 
least change* The Language-Experience teachers started at the desired level and 
then went up, down, and up again* 
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at 8U0ce8sive “Stingy to aim « cio»«lsr - 

t^Toklun StSr'CSST'X ZrZ t0 T «Slch 

an increase in the ttae per a^be^rteftf^ Tff adJUStine to 

poriio^o/ttoe^ent S heading AcSrttl* 116 *"* “ ain approaohee in «* Pro- 

As can be seen In SSL * ttf&S2?2VflS3^ *° S’?? 0 * 1 ™ Activities. 

ucners in tht. Skills -Centered Approach spent 55.5 

Table 2 

Percents of Instructional Time Devoted to 



— Variable 


Percentage of Instructional Time! 


Heading 

Activities 


supportive 

Actiirl oa 


Skillg-Centered Approach 


55-5 


■ v 1 uaCo 

44.5 


I* Basal Header Method 


56 


44 


!!• Phonovisual Method 


55 


45 


| language-Experience Approach 


39-5 


60.5 


III. Banguage-Eaperience Method 


42 


58 


IV. L-E Audio-Visual Method 


57 


63 



spent only* ^^^per^cent of a theL A timI i ^ ie p W ^ e Lar ^ ge * :E5qperienc e teachers 
smaa-cStered t£chS the 

while the laaguage-ExneriSee ^ 1 Sportive Activities, 

portive ActiXfl ^e SS e ~^f^ ent i°l per cent of tbetf time 1” sip- 
(d < cf> ) u difference between the two approaches is significant 

and n^signifi^t? approach the Terence between the two mettoL is small 

San l a l th . e . Btar ! f «* ®~iect by the 

quectioiWro , the CRA^^tf^ers °i Re ad1n .^ Ac cordirg to that 

score significantly t^ZTv< a as a group to 
on a scale of languaS^cDerienee^ oriot?** ^ 0f Reader Practices than 
SffiDiegoJnveSrft STmTS A 8econd «®*nistration of the 

Had changed eign^cantly in the direction JJj®* f aah &<*%> of teachers 

assigned* direction of the method to which they had been 



i gMB W W 



8 . 



itemi^ 1 v^? r ^ e,lfe p 8 ^? n J age tiffle P« ^ spent on each of the five 
fectivitiee, by method. °* th * t#a kiadf <* sspportiv* 



Table 3 



Percentages of Time Spent on Specific Reading and 
Supportive Activities in Pour Teaching Methods 





SkiUs-Centered 


Language-Experience 




ACTIVITIES 


I 


II 


XLC 1 IV * 


» 

t 




Basal 


Phono- 


Language 


Lang. -Exp. 


1 p 




Reader 


Visual 


Experience ‘ Audio-Vis , 


I P 


Reading Activities 


5 Gf> 


53* 


42$ 


1 3756 




Basal Reader 


28,8 


< 

25.3 


3.3 


■ 2.0 


< .01 


Experience Chart 


6.9 


4.7 


12.6 


j 10.9 


< .01 


Sight' Word Practice 


8.2 


5.7 


7.7 


6.9 


Ki 


Ebonics 


8.2 


17.2 


7.7 


7.6 


< .01 


Other Reading Activitie 


3-9 | 2.1 

■ 


10.7 


9*6 


< .01 


Supportive Activities 


44$ 


j *5* 


58 $ 


6 % 




Story-Telling: 


8.7 


< 

10.0 


9*4 


7.1 


IB 


Discussion 


5.8 


8 . 0 


10.6 


10.2 


fiS 


Writing 


9*2 


9.6 


12.3 


12.1 


IB 


Audio-Visual 


2.4 


2.1 


1.9 


9*2 


< .CEL 


Audio-Vis with Discus- 
sion 


1.0 


1.2 


1.1 


5.9 


< .01 


Dramatisation 


2.2 


2.7 


3.6 


2.7 


IB 


Art Word with Reading 


4.8 


3.4 


9.4 


8.1 


MS 


Other Language Arts 


2 .6 ] 


| 1.2 


4.2 


2.6 


NS 


Social Studies 


3.9 


3.9 


2.7 


2*8 


NS 


Science 


3.4 


2.9 


2.8 


2.3 


m 


Total 


100 $ 


100 $ 


100 $ 


100 $ 

j 
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iBtoth ^ Nearly- Iteachers 

totf in the use of basal reS ?“* of their total Language 

of the Jr time on phonics: the other twJP 18 ^onortsual teachers spent 17 per cent 
Phonics. The two togua^S^?!! * hree « rCT « ,s averaged eight p£r cent IT 

teLh 0ll0ring: “^^ence charts, aie^^i, 4 *^* 4 4 ° *0 12 P 1 ^ cent to each of 
teacher averaged about 15 par cent of ttatotLf* "Tjtiag. ®» Audio-Visual 
cedures, while the other Xanguaae-lSe^ time ? n the use of audio-visual pro- 
Skills-Centered teachers ^^^^ h te ' aberB 804 the two groups «F P 
srall amount of tine llstelfo^l^iS stSiaa^r^* 1 " 16 111 tid * £ysa ' «* 

67 ^ te ° de0Cy of tether. to list these^^y^wK ? 17 eXPlaiDed 

cMldren and to stimulate Ss^i^lnd^HT?? 864 t0 teU 884 read stories to the 
avocations of time to these actiYitief^^^^K JF 16 results Bhov substantial 
8-ightly less used by the Fhonovisual teaew.^^f; Slght word Practice was 
category were not significant. Th* «o^ Ca ? le ^f , bufc tlle differences in this 

more than twice as S by the iSL^e-^n!^ *® V^ POrtive activity was used 
Centers^ teachers. "®nguage Experience ttachers than by the Skills- 

Sicti 1 ^ 8 ^ “ft^^e^ef wS statisti “tivities listed 

direction consistent with a priwi 8 *g“iPi«urt, all in tfcc 

t“al reader, experience charEsT^honic^^hfr*^* 1 ” “thods, these were: 
activity, and audio-visual with diSaiJnf rea4iD « activities, audio-visual 

the four^methods* ^^f!. 1 ® 8 ! 4 '? 4 aPPrcodaately the sane anount of time in 

writing, other language arts, SociS Studie. 1 '^ 1 ? 6 ? St0ry te Htug, discussion, 
showed non-significant tendencies in Science. Discussion and writing 

8»a«e -Experience nethoS“lr^r> “ re ^t 8848 * the tanT 6 

ence between approaches, but not betweeS ^ JSSh"* dm "- 

Sgnary and finnci,..^^ * 

f lrst^^°^^^ t ^ a 8 ^:^t lon of ^tine in tie teaching of language Arts to 

of the relative effectiveness of aethS dur4n S the investigation 

segregated areas of New York Cityr^JT S L^SSf 4 ” 6 rea44ng 40 three racially 
centered in Basal Readers with 2d wtt2!f ^ S^hods were Sldlls-Centered, i.e.. 
Instruction. Two of the methods were t»u»u? IhcnovisuaX method of phonics 
audio-visual supplementation. ^“ensse-EKperience, with and without 



The findings may be susnarized as follows: 



t-d^g £**£*£» spent, on 

5 dsya of each subsequent mo^tett^' fSfc “ontfcs sod them for 

of time they spent ^ported the percentage 

dag* •ctlvities in the four Hsthods^tte (SOT^a^ **“ Sl ® port4 ' re l8n - 
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city * U» PWj.rt w.eM tba 

«”grss^rs as, wssurss "“-* °» *— 
sz£5ss$Zr ^~~zsr-T&Sf 

^^t^^ iVltlai aSPrqprlite t0 tbe »»W 0^ ^ruet Z to .hid, 

_. m .*I' ? 8c ?. g f 0,5> of teacbers "®* foaai to emphasize the soecifie activities 

£ ^in^time tesc W n 8- Statistical^ significant dif- 

ki n. ff “ «P«nt,seoe of them very large, were found for six of the fiftean 
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BISTRUgriONS FOR RECORDING BEHAVIOR VfITE OScAR R* 

Donald M. Medley and Lou Hicks Smith 

i 

Background 

OScAR R (Observation Schedule and Record - Reading) was developed by this 
office in order to assist in the implementation of the First-Grade Reading Pro- 
ject (CRAFT). It has a two-fold purpose: (l) it should provide some record of 
the degree to which teachers in the experiment implement the variables assigned 
to them; (2) it should yield information about similarities anl differences in 
the behaviors of teachers assigned the same method. If such behaviors affect 
the rate at which pupils learn to read, this information can be used in the 
analysis of the data to increase the precision of the methods comparisons. 

The schedule has two sections, one printed on tne front and the other on 
the back of a five-by- eight card, (toe side is called the "Static” section 
(OScAR Rs) and the other is called the "Dynamic" section (OScAR Bd). The Static 
section is designed to yield a description of the range and variety of activities 
and materials observed in the classroom, analogous to a still photograph. The 
Dynamic section, which focuses on the verbal behavior only, is designed to yield 
a running description of the pattern of teacher statements and of the verbal 
interchanges between teacher and pupils. The categories into which behaviors 
are coded on both sides are designed to involve only simple, non- evaluative 
discriminations which can be made by relatively unsophisticated observers after 
a brief period of training. 

General Proced ure 

The basic unit of observation is a ten-minute period. During the first 
three minutes, behaviors are coded on the Static side. During the second seven 
minutes, behaviors are coded on the Dynamic side. 

are scheduled ahead of time, and teachers are requested to arrange 
their school days so that a la n gua g e arts lesson will be scheduled while the 
observer is in the classroom. 

At the appointed time the observer enters the room as unobtrusively as 
possible and takes a seat near the rear. He first fills in the sections at the 
right of the Static side of the card, beginning by indicating the date and the 
time in the spaces provided. (See attached copy of OScAR.) Next he checks in 
the box in the upper right corner any audio-visual, materials being used, in the 
column headed "S" and the organization of the class into groups in the box 
immediately below. He then starts his stop watch, and for three minutes records 

A? e J .v CtiV ^ ie8 and nafcer * a * 8 observes in the main body of the Static section. 
At the ox x of three minutes, he stops his watch, and indicates the audio-visual 
equipment then being used, and the organization of the class into groups. This 
time he makes his marks in the column headed "D" • Then he turns the card over, 
starts his watch again, and for seven minutes tallies verbal behavior on the 
1 side of the card. At the and of six minutes , he stops his watch and 



* This is a prepublication draft not to be cited or reproduced without the 
permission of the authors. 



makes any appropriate notations in the box for "Remarks" (on the Static side). 

If observation is to continue, he begins ell over with a new card. 

This 10-minute "period" of observation (which is recorded on one card) 
constitutes the primary unit of observation, 9 minutes of which are recorded. 
Observers in the CRAFT Project are instructed to obtain three consecutive 
periods of observation per visit for use in the analysis of the experiment. They 
have also been asked, when possible, to obtain one extra period of observation 
during each visit for use in item analysis, preceding the analysis of the results 
of the experiment. 

Although the instrument is designed primarily for use during lessons 
whose goal is the teaching of reading, observers are instructed to record any 
teacher behavior that occurs during a visit, with one exception. In case the 
teacher finishes a lesson while the stop watch is running, and begins a rest or 
snack period, the observer will continue to code whatever behaviors he observes 
until it is time to stop the watch. But he will not start the watch a gain until 
the end of the rest or snack period. 

Detailed Procedure - St atic Side 

The eight small boxes at the upper right are used for identifying code 
numbers for this Office* s First-Grade Reading Project.. The following inforra- 
tion is coded: Observer, Visit Iftmber, Time Period Within Visit, Visit Humber 

Given by Observer, Variable, Consultant, School within District, Teacher within 
Variable. This section is completed before the observer enters the classroom. 

Imme diately below these boxes is a section in which use of the following 
audio-visual equipment is to be checked: Motion Picture Projector, Slide/Strip 
Projector, Tape Recorder, Phonograph, Overhead Projector, Camera. These items 
are checked only if such equipment is in use at the time when the block is 
checked. By choosing tfcu "S" or the "D" column, the observer indicates whether 
the equipment was in use at the beginning of the Static or the Dynamic phase of 
the period. 

Below the audio-visual block there appears a section which is used for 
recording the group structure of the classroom. A different row is used by 
the observer to record each discemable functional group which appears in the 
classroom at the begin n i n g of each of the two phases (Dynamic and Static). 

The observer counts the number of children in each group he sees, an d writes 
this number in one of the cells in Column S or D as the case may be. If only 
one group appears in the classroom (the entire class), the observer records the 
total number in the entire classroom in the top box. A check is made in the 
adjoining box (column headed "T") to indicate which group the teacher is with. 

The blank box in the lower right-hand side, labelled "HMKS" is used to 
record brief summary comments about the activities occurring during the entire 
observation period, particularly anything unmmai which might occur. 

The main body of the Static side, which appears to the left of these 
small sections, consists of a two-way classification: what activities occur 
during the three-minute period and wfent materials are used in these activities? 



Figures 1 and 2 are included to clarify the process by which the observer codes 
the behaviors and locates the calls in which they are to be recorded* The 
process is sequential in the scase that in order to code a behavior the observer 
roust make a series of separate discriminations* The 20 activities are listed 
vertically, and the 18 categories of materials are arranged horizontally in a 
pattern designed to facilitate recording* 

Materials The organisation of materials can perhaps best be understood 
by a close examination of Figure 1* 

If the activity observed is such that no mate] rials are used (if , for 
example, the teacher is telling a story) the category "Bo Materials" ia used* 

If materials are involved, the first discrimination to be made occurs at 
level 1 of Figure 1: between Books, Display Materials, and Hand-held Materials. 

Under the general category Books there are two major subdivisions: 
Published Books and Homemade Books* 

Published Books are divided into three types: Basal Readers, Workbooks, 
and Supplementary Books* Basal Readers include pre-primers, primers, etc* in 
whatever series the teacher uses* Workbooks are designed to be written in* 
Supplementary Books include aay published books, such as story books, which are 
not used in the basal reader series being used* Reaclers from other series 
fall into this category* 

Homemade Books include the paapllet-like books prepared by the teacher or 
the pupil* Words or letters must appear oa such booklets in order for this 
category to be checked* Illustrations may or may not appear* 

Whether the booklet is teacher— or pupil— produced is determined by 
the apparent "author" of the story, i*e*, a story recorded and reproduced by a 
teacher, but dictated by a pupil, is considered pupil-jiroduoed* It mlgjxt be 
added that teachers often assist in discriminating these two categories by 
a nnouncin g the author of the booklet, if it ia pupil-jn reduced* 

The second major category on Level 1 of Figure 1, Display Materials, 
i n clud e s Charts and Boards* 

Display Charts in cl ude Experience Charts which, are always, of course, 
h omemade and Bionics Charts which may or say not be hememade* 

Experience Charts may bo ccoposed of words, phrases, or sentences* The 
pupil (s) generate these charts with some direction from the teacher* Bionics 
Charts deal with letters or words and are used in a manner which focuses on 
the sound, form, or structure of the letter or word* 

Charts which cannot be classified as either Experience or Bionics c farts 
are tallied as "other charts" • 

Display Boards* Any use of the chalkboard or blackboard, whether for 
words or pictures, is tellied tsnte "Chalk." Any active use of a bulletin board, 
or materials displayed thereon, is tallied under "Bulletin*" 
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+w* ji® 16 J^categosfy "Object" refers to either commercial or h«n»nmd» 
wr^dimensional objects which are actually used in instruction. Globes, statues, 
leaves* masks* and the like would he tallied here. 9 

ttr *r+\ n J^" ha 5?‘’? ft3 f f??^ 8 *** those handheld objects (three-dimensional 
or not) which cannot he tallied elsewhere. 

hand ^l^^***” ? ecial category which is checked when any homemade 

used * 111 svch a® Instance* the material would he checked 
* , a Pfctjjre made by a pupU were used* it would be recorded twice-under 

card* strip* etc." and under "pupil-produced*" 

<rf ' list of materials on the card will indicate the 
relationship between their arrangement and the category system Just described. 

*+ activities, the first discrimination to he mode* 
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Interactive ftCl * r " actiYitie8 sub-divided at level 2 into Kon- Interactive and 

_ .. Nonp-Interactive Activities include: "Reads aloud"* which refers to the 
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Lrteractive Teacher Behaviors are classi f ied into two categories (on Level 3 
of Figure 2): Oral and Koa-Qral . , 

Oral Interactive Teacher Activitie* Include Brining, Artdng Questions, 
and Atuwering (pupU-imtUted) Querticn*. ^ ^ ’ 

"BtUUng" refers to an activity in vhlch the teacher elicits moil 

F** 1 *??* neohanlcal type, often «n Basse. "Ask Question' 
and Answers Question" should he self explanatory. 

, . "Works with Individual" Is che ck ed If special attention la addressed by 
the teacher to one child, with the rest of the class being i gnor ed(appsreatlv)- 
"works with saall grot®" la tallied when a group certalnit* fts^S^mOfar 
the class appears to receive tbs exclusive attention efthe teacher . 

( 2 ) i. ocerolse" is tallied If (l) the gane Is teacher-led, end 

( ai l s primarily of a non-cognitiva or tension-release variety. If a teacher 
*. ,one . w f th ’**? h *•» OTPlla are familiar, one night tally thia category. 
2J?“ ewe"ia really a drill and does not seem to he tm, it is checked as a 

S W ^ * tW1V8B th8 “W i» recorded 

be tam^^^ 01 ” 10118 * Uncateeorized teaeher actlvitle « «V 

Pupil Activities are classified at Level 2 of Table 2 into three 
C S!^T; e8: . Teacher “ like ^ Verbal, and Small-Group. Teacher-like pm>il 

^+i, i,mave *?* roll,# Providing sane instruction or illustration to the 
^ I"" le f s^ervisioa by the teacher, and are classified 

into three sub-categories (Level k)» "Works at board, chart," is tallied when 

2 receive ^instruction at any of the various types of boards 

and (Aarts. Acts out refers to any type of instructionally^crieiifced dramatize 
tion by a pupil or ^roup of ptpils. ™-v «»***.»- 

tallied when a pupil reads several wordi or sentences 
aloud while the others listen. 

Oral Activiti.es incl u d e Sharing, Discussing, and Dictating. 

iu , Shares has reference to "experience sharing," an inpertant component of 

^mn?S 8 ^frf^ ie,lce wroaoh t0 teaching* SQ>orience sharing invo^s a 
P^?il s relating a personal experience in his own language and in his own way. 

"Discusses" is tallied when pupil-teacher or pupil-pupil interactions 
occur, all focused about a particular topic. Discussions are typically teacher- 
led, however, pupil responses should modify the teacher statements to sense extent. 

nr vben a pupil relates a sequence of words, phrases 

or sentences, which the teacher writes down. The pupil statements should not 

teacher; "dictates" should not be checked when the 
*? the missing letter or word in a mrd or sentence. 
Dictates would be tallied when, for example, the teaeher records a pupil starve 
cr >#hen she records "words about winter. " OTy# 
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The decision that what the teacher say s does not call for an lame llate 
p^pil response identifies it as a statement ; a decision that it does call for a 
pupil reply identifies it as an entr^ to 11 an interchange* 

Statements are classified into six categories according to their apparent 

purpose# 



Motivational statements arc tallied as "Positive” or "Negative"* "Positive 
statements are intended to increase a pupil’s motivation to learn* to reduce 
tension; or more simply* to make him feel better* Statements which might be 
tallied here are: "This is going to be a lot of fun;" "Cfa, that’s quite 
alright, don’t worry about that," etc* 

Negative motivational statements include statements which tend to 
a pupil feel bad; most of them consist of a teacher’s correction or criticism 
of pupil behavior. Statements varying widely in degree of severity are tallied 
in this category* The range extends, roughly, ftexa a neutrally-stated : "Don’t 
do that" (when such a statement does not appear to be a procedural instruction) 
to punitive shouting* 

Problem-centered statements fall into three types: Problem-structuring- 
Meaning; Problem-structuring - Farm, and Exposition* 

Problem- structuring statements pose a problem to the class as a group, 
for example, "I wonder if anybody can tell me what the first sentence says?" 

"Problem-Structuring-Meaning” is tallied when the problem involves 
understanding or interpretation of words or sentences* "Problem-Structuring-Fcrm" 
tallies represent teacher statements concerned with the form, structure, or rote 
repetition of a letter, word, as for example, "What is the first word on page 3? 

"Exposition" is tallied when the teacher statement simply provides 
information to the ptpuls* Story-reading or story telling by the teacher would be 
tallied in this category o So would explanations of how to do something* 

Procedural statements are classified as Directive or Descriptive* Both 
involve statements about what is to be done which are empty of content; the 
difference between them lies in the degree to which pupil behavior is restricted* 
Today we are going to read a story" is descriptive; "Open your books" is 
directive* 

Interchange-, An interchange is an episode which normally begins with 
a teacher question, continues with a pupil response, and ends with a reply from 
the teacher, usually evaluative of the pupil response* dr* tally is made for 
each interchange under the type of entry, and opposite the type of evaluation. 

By the entry to an interchange is meant the question asked by the teacher 
which initiates the episode. Entries are classified according to the type of 
task set the pupil; when it involves interpretation of a word, sentence, or other 
symbol, so the pupil must understand the symbol in order to execute the task, the 
entry involves meaning; if he need only recognize the symbol, it involves form 




s 88 * distinction is made in classifying Problem-Structuring 
Statements (see above). The difference between a Problem-Structuring Statement 
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